Reproducible data for notebooks

JupyterCon 2018

Aneesh Karve

Quilt Data

@akarve

Jackson Brown

Allen Institute for Cell Science

@jacksonmaxfield (GitHub)

Tech partnership

  • Distribute terabytes of open images
  • Reproducible analysis

Notebooks are fragile

  • Break when shared
  • Break over time
  • Break across machines

foo

Reproducible notebook = f(code, data)

  • pure function
  • depends only on parameters

Code has gotten most of the attention

  • pip install quilt==2.9.9
  • git checkout 424ef3
  • docker run -i 8dbd9e392a96

"It's so bad it sometimes feels like stepping back in time to when we coded without source control."

- Pete Warden, Staff Research Engineer, Google

Quilt is an open source data package manager

Data package lifecycle

from quilt.data.aics import aics24

Any data, any size

  • JSON, Parquet, JPEG, models, etc.
  • 0KB to 10TB

What scientists are used to

What we're moving towards

quilt.install("aics/random_sample")

quilt catalog

You have scientists that want to share everything that comes to their computer.

They don't know how to do that.

That's your job.

Scientists to me:

Where the f@#* are my files?

And did anyone mess with them?

high res, detailed

30 TB and growing

Four use cases

  1. Share data
  2. Slice data
  3. Deserialize data
  4. Load model

Share data

d1 = np.random.rand(100, 100)
quilt.build("akarve/experiments/d1", d1)
quilt.push("akarve/experiments")
In [ ]:
quilt.install("akarve/experiments/d1")
In [31]:
from quilt.data.akarve import experiments as ex

ex.d1()
Out[31]:
array([[0.91573315, 0.85691562, 0.7882781 , ..., 0.42122528, 0.37429233,
        0.54934284],
       [0.13196131, 0.97855543, 0.49203112, ..., 0.49168316, 0.67839812,
        0.1111215 ],
       [0.87381301, 0.5690807 , 0.74833866, ..., 0.16887445, 0.2698536 ,
        0.41853545],
       ...,
       [0.76138671, 0.2967224 , 0.4810172 , ..., 0.50669421, 0.24303345,
        0.00968639],
       [0.54994613, 0.55630247, 0.42391142, ..., 0.01679875, 0.73908468,
        0.61485167],
       [0.66168409, 0.17894292, 0.61340792, ..., 0.74609356, 0.70575113,
        0.08506596]])

Slice data

  • Subset large data
In [15]:
quilt.install("aics/random_sample/cell_segs")

Downloading package metadata...
aics/random_sample/cell_segs already installed.
Overwrite? (y/n) y
Fragments already downloaded
In [6]:
from quilt.data.aics import random_sample
random_sample.cell_segs
Out[6]:
<GroupNode>
cell_plate_3500000680_well_E8_100X_20170307_E08_P05czi_cellW/
cell_plate_3500000684_well_E7_100X_20170307_E07_P36czi_cellW/
cell_plate_3500000765_well_D4_100X_20170328_2_Scene_04_P11_D0/
cell_plate_3500000922_well_F7_100X_20170522_2_Scene_21_P41_F0/
cell_plate_3500000943_well_E4_100X_20170530_2_Scene_4_P8_E04/
cell_plate_3500000953_well_E5_100X_20170607_5e_Scene_1_P37_E0/
cell_plate_3500000956_well_E5_100X_20170606_2e_Scene_2_P11_E0/
cell_plate_3500000961_well_F8_100X_20170609_2_Scene_28_P49_F0/
cell_plate_3500000982_well_E4_100X_20170620_1_Scene_03_P3_E04/
cell_plate_3500000987_well_F4_100X_20170619_5_Scene_3_P27_F04/
cell_plate_3500000987_well_F5_100X_20170619_5_Scene_6_P30_F05/
cell_plate_3500001003_well_F8_100X_20170623_2_Scene_17_P42_F0/
cell_plate_3500001086_well_E5_100X_20170719_17_65_2c_Scene_06/
cell_plate_3500001108_well_E7_100X_20170724_1c_Scene_05_P5_E0/
cell_plate_3500001123_well_F6_100X_20170725_4_Scene_06_P26_F0/
cell_plate_3500001175_well_E4_100X_20170811_1e_Scene_03_P7_E0/
cell_plate_3500001282_well_E4_100X_20170912_1r_Scene_01_P2_E0/
cell_plate_3500001307_well_E5_100X_20170919_16_184_1r_Scene_0/
cell_plate_3500001345_well_E6_100X_20170926_3_Scene_03_P13_E0/
cell_plate_3500001410_well_F5_100X_20171016_4r_Scene_4_P11_F0/

Publish hashes = reproducible papers

quilt.install("your_lab/your_paper", hash="cd410f14")

Slice Google Open Images (9M, 18TB)

alt text

Slice positive examples

In [20]:
pretzel = """
select * from "frags_openimages_trainable-human-bbox"
where contains(split(alldescriptionsforimageid, ',') , 'Pretzel');
"""
In [22]:
quilt3.query(pretzel)
Out[22]:
labelname description imageid source confidence xmin xmax ymin ymax isoccluded ... originallandingurl license authorprofileurl author title originalsize originalmd5 thumbnail300kurl alldescriptionsforimageid __index_level_0__
0 /m/02wbm Food 30e176d97ebab334 freeform 1 0.163008 0.782618 0.032131 0.9999030000000001 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520826
1 /m/052lwg6 Baked goods 30e176d97ebab334 freeform 1 0.211921 0.385875 0.794797 1.0 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520827
2 /m/052lwg6 Baked goods 30e176d97ebab334 freeform 1 0.247824 0.688983 0.287404 0.840259 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520828
3 /m/01ww8y Snack 30e176d97ebab334 freeform 1 0.246798 0.688526 0.284063 0.854086 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520829
4 /m/01f91_ Pretzel 30e176d97ebab334 freeform 1 0.089193 0.185547 0.348958 0.47569399999999995 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520830
5 /m/01f91_ Pretzel 30e176d97ebab334 freeform 1 0.246745 0.5618489999999999 0.284722 0.706597 1 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520831
6 /m/01f91_ Pretzel 30e176d97ebab334 freeform 1 0.36783899999999997 0.690755 0.46006899999999995 0.848958 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520832
7 /m/01f91_ Pretzel 30e176d97ebab334 freeform 1 0.8600260000000001 0.9602860000000001 0.340278 0.46701400000000004 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520833
8 /m/01f91_ Pretzel 30e176d97ebab334 freeform 1 0.8964840000000001 0.999375 0.078125 0.128472 0 ... https://www.flickr.com/photos/picsoflife/82762... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/picsoflife/ Ari Helminen Nam nam in Tokyo! 2372437 e3ueHBkKT9XArpZWExkNbw== https://c6.staticflickr.com/9/8499/8276266613_... Food,Baked goods,Snack,Pretzel 520834
9 /m/02wbm Food d03f66f4a1d21440 freeform 1 0.188245 0.8171689999999999 0.196744 1.0 0 ... https://www.flickr.com/photos/adactio/6375607119 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/adactio/ Jeremy Keith One last taste of Germany before heading back ... 104355 SwX6qjmedEJ1W41HVsrcWQ== https://c2.staticflickr.com/7/6218/6375607119_... Food,Coffee cup,Coffee,Pretzel 529072
10 /m/02p5f1q Coffee cup d03f66f4a1d21440 freeform 1 0.350549 0.809926 0.004485 0.310737 0 ... https://www.flickr.com/photos/adactio/6375607119 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/adactio/ Jeremy Keith One last taste of Germany before heading back ... 104355 SwX6qjmedEJ1W41HVsrcWQ== https://c2.staticflickr.com/7/6218/6375607119_... Food,Coffee cup,Coffee,Pretzel 529073
11 /m/02vqfm Coffee d03f66f4a1d21440 freeform 1 0.46404700000000004 0.785779 0.015097 0.131252 0 ... https://www.flickr.com/photos/adactio/6375607119 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/adactio/ Jeremy Keith One last taste of Germany before heading back ... 104355 SwX6qjmedEJ1W41HVsrcWQ== https://c2.staticflickr.com/7/6218/6375607119_... Food,Coffee cup,Coffee,Pretzel 529074
12 /m/01f91_ Pretzel d03f66f4a1d21440 freeform 1 0.168962 0.8204229999999999 0.32590399999999997 0.855533 0 ... https://www.flickr.com/photos/adactio/6375607119 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/adactio/ Jeremy Keith One last taste of Germany before heading back ... 104355 SwX6qjmedEJ1W41HVsrcWQ== https://c2.staticflickr.com/7/6218/6375607119_... Food,Coffee cup,Coffee,Pretzel 529075
13 /m/052lwg6 Baked goods 48f3db503f5f720e freeform 1 3.52E-4 0.795755 0.109752 1.0 0 ... https://www.flickr.com/photos/nikonvscanon/448... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/nikonvscanon/ David Blaikie Fresh complementary Prezzels 4878707 4+iRmg/MDCUyYY5ARV9LQw== https://c1.staticflickr.com/5/4008/4488463620_... Baked goods,Pretzel 577751
14 /m/01f91_ Pretzel 48f3db503f5f720e freeform 1 0.0 0.6985680000000001 0.269097 0.999167 1 ... https://www.flickr.com/photos/nikonvscanon/448... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/nikonvscanon/ David Blaikie Fresh complementary Prezzels 4878707 4+iRmg/MDCUyYY5ARV9LQw== https://c1.staticflickr.com/5/4008/4488463620_... Baked goods,Pretzel 577752
15 /m/01f91_ Pretzel 48f3db503f5f720e freeform 1 0.108724 0.7128909999999999 0.11458299999999999 0.333333 0 ... https://www.flickr.com/photos/nikonvscanon/448... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/nikonvscanon/ David Blaikie Fresh complementary Prezzels 4878707 4+iRmg/MDCUyYY5ARV9LQw== https://c1.staticflickr.com/5/4008/4488463620_... Baked goods,Pretzel 577753
16 /m/01f91_ Pretzel 48f3db503f5f720e freeform 1 0.240234 0.798828 0.274306 0.671875 1 ... https://www.flickr.com/photos/nikonvscanon/448... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/nikonvscanon/ David Blaikie Fresh complementary Prezzels 4878707 4+iRmg/MDCUyYY5ARV9LQw== https://c1.staticflickr.com/5/4008/4488463620_... Baked goods,Pretzel 577754
17 /m/052lwg6 Baked goods 64f83d37b59dea70 freeform 1 0.216044 0.998208 1.97E-4 0.796825 0 ... https://www.flickr.com/photos/andreea_blog/161... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/andreea_blog/ Andreea Bretzel 60503 iO5Q059Bo53T3PIK38pASw== https://c6.staticflickr.com/1/19/161921366_1b5... Baked goods,Dessert,Snack,Fast food,Pretzel 578425
18 /m/0270h Dessert 64f83d37b59dea70 freeform 1 0.20807199999999998 0.999503 0.0 0.79106 0 ... https://www.flickr.com/photos/andreea_blog/161... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/andreea_blog/ Andreea Bretzel 60503 iO5Q059Bo53T3PIK38pASw== https://c6.staticflickr.com/1/19/161921366_1b5... Baked goods,Dessert,Snack,Fast food,Pretzel 578426
19 /m/01ww8y Snack 64f83d37b59dea70 freeform 1 0.20913099999999998 1.0 5.7999999999999994E-5 0.80179 0 ... https://www.flickr.com/photos/andreea_blog/161... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/andreea_blog/ Andreea Bretzel 60503 iO5Q059Bo53T3PIK38pASw== https://c6.staticflickr.com/1/19/161921366_1b5... Baked goods,Dessert,Snack,Fast food,Pretzel 578427
20 /m/01_bhs Fast food 64f83d37b59dea70 freeform 1 0.210063 1.0 2.97E-4 0.795686 0 ... https://www.flickr.com/photos/andreea_blog/161... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/andreea_blog/ Andreea Bretzel 60503 iO5Q059Bo53T3PIK38pASw== https://c6.staticflickr.com/1/19/161921366_1b5... Baked goods,Dessert,Snack,Fast food,Pretzel 578428
21 /m/01f91_ Pretzel 64f83d37b59dea70 freeform 1 0.20736300000000002 0.997917 5.71E-4 0.412112 1 ... https://www.flickr.com/photos/andreea_blog/161... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/andreea_blog/ Andreea Bretzel 60503 iO5Q059Bo53T3PIK38pASw== https://c6.staticflickr.com/1/19/161921366_1b5... Baked goods,Dessert,Snack,Fast food,Pretzel 578429
22 /m/01f91_ Pretzel 64f83d37b59dea70 freeform 1 0.241765 0.9177770000000001 0.377279 0.793981 1 ... https://www.flickr.com/photos/andreea_blog/161... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/andreea_blog/ Andreea Bretzel 60503 iO5Q059Bo53T3PIK38pASw== https://c6.staticflickr.com/1/19/161921366_1b5... Baked goods,Dessert,Snack,Fast food,Pretzel 578430
23 /m/0270h Dessert 0e656d2824b32f45 freeform 1 0.0 1.0 3.84E-4 1.0 0 ... https://www.flickr.com/photos/razvanorendovici... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/razvanorendovici/ Razvan Orendovici Pretzels 5183567 /+md0aG7amM7DlAbf1TMIA== https://c8.staticflickr.com/5/4059/4471140324_... Dessert,Bread,Bagel,Pretzel 582150
24 /m/09728 Bread 0e656d2824b32f45 freeform 1 0.0 0.999991 0.0 1.0 0 ... https://www.flickr.com/photos/razvanorendovici... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/razvanorendovici/ Razvan Orendovici Pretzels 5183567 /+md0aG7amM7DlAbf1TMIA== https://c8.staticflickr.com/5/4059/4471140324_... Dessert,Bread,Bagel,Pretzel 582151
25 /m/01fb_0 Bagel 0e656d2824b32f45 freeform 1 0.0 1.0 0.0 1.0 0 ... https://www.flickr.com/photos/razvanorendovici... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/razvanorendovici/ Razvan Orendovici Pretzels 5183567 /+md0aG7amM7DlAbf1TMIA== https://c8.staticflickr.com/5/4059/4471140324_... Dessert,Bread,Bagel,Pretzel 582152
26 /m/01f91_ Pretzel 0e656d2824b32f45 freeform 1 0.0 0.999509 0.0 1.0 1 ... https://www.flickr.com/photos/razvanorendovici... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/razvanorendovici/ Razvan Orendovici Pretzels 5183567 /+md0aG7amM7DlAbf1TMIA== https://c8.staticflickr.com/5/4059/4471140324_... Dessert,Bread,Bagel,Pretzel 582153
27 /m/0270h Dessert 10514628bd95491f freeform 1 0.0 0.899156 0.030902999999999996 1.0 1 ... https://www.flickr.com/photos/marysuephotoeth/... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/marysuephotoeth/ Mary Sue Pretzels! 132186 2x4gcHKHioRZxYX0kTcq7g== https://c3.staticflickr.com/1/140/324449965_9c... Dessert,Pretzel 582169
28 /m/01f91_ Pretzel 10514628bd95491f freeform 1 0.0 0.899882 0.03011 1.0 0 ... https://www.flickr.com/photos/marysuephotoeth/... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/marysuephotoeth/ Mary Sue Pretzels! 132186 2x4gcHKHioRZxYX0kTcq7g== https://c3.staticflickr.com/1/140/324449965_9c... Dessert,Pretzel 582170
29 /m/0270h Dessert 48e12511ffc3e336 freeform 1 0.0 0.330173 0.0 0.215813 0 ... https://www.flickr.com/photos/heart_windows_ar... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/heart_windows_art/ Heart Windows Art My homemade pretzel 762017 wctgsvnReFiJpG3hBWPTUA== https://c4.staticflickr.com/5/4135/4870317642_... Dessert,Bagel,Pretzel 582779
... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...
40 /m/01f91_ Pretzel 4b1d09f4e14e4017 freeform 1 0.080748 0.9773860000000001 3.01E-4 0.9994719999999999 0 ... https://www.flickr.com/photos/mrsdkrebs/584333... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/mrsdkrebs/ Denise Krebs Warm Soft Pretzels 2634235 IVcs3JHkDVQI2azoj2Yc/w== https://c1.staticflickr.com/3/2571/5843339718_... Dessert,Bread,Pretzel 582802
41 /m/0270h Dessert b957273ded1d3723 freeform 1 0.195529 0.9356450000000001 0.057058000000000005 1.0 0 ... https://www.flickr.com/photos/insatiablemunchi... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/insatiablemunchies/ insatiablemunch Review of The Whisk and Crumb 224701 k4FzmlsN610oB8Fw6lP2Og== https://c1.staticflickr.com/1/281/19238130051_... Dessert,Snack,Pretzel 583881
42 /m/0270h Dessert b957273ded1d3723 freeform 1 0.880542 1.0 0.699136 1.0 0 ... https://www.flickr.com/photos/insatiablemunchi... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/insatiablemunchies/ insatiablemunch Review of The Whisk and Crumb 224701 k4FzmlsN610oB8Fw6lP2Og== https://c1.staticflickr.com/1/281/19238130051_... Dessert,Snack,Pretzel 583882
43 /m/01ww8y Snack b957273ded1d3723 freeform 1 0.192721 0.932398 0.05524400000000001 1.0 0 ... https://www.flickr.com/photos/insatiablemunchi... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/insatiablemunchies/ insatiablemunch Review of The Whisk and Crumb 224701 k4FzmlsN610oB8Fw6lP2Og== https://c1.staticflickr.com/1/281/19238130051_... Dessert,Snack,Pretzel 583883
44 /m/01ww8y Snack b957273ded1d3723 freeform 1 0.880669 1.0 0.70072 1.0 0 ... https://www.flickr.com/photos/insatiablemunchi... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/insatiablemunchies/ insatiablemunch Review of The Whisk and Crumb 224701 k4FzmlsN610oB8Fw6lP2Og== https://c1.staticflickr.com/1/281/19238130051_... Dessert,Snack,Pretzel 583884
45 /m/01f91_ Pretzel b957273ded1d3723 freeform 1 0.45226400000000005 0.932091 0.058671 0.74869 1 ... https://www.flickr.com/photos/insatiablemunchi... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/insatiablemunchies/ insatiablemunch Review of The Whisk and Crumb 224701 k4FzmlsN610oB8Fw6lP2Og== https://c1.staticflickr.com/1/281/19238130051_... Dessert,Snack,Pretzel 583885
46 /m/0k65p Hand cfd9d474fcb239f6 freeform 1 0.0 0.355885 0.6970310000000001 0.999972 0 ... https://www.flickr.com/photos/alper/14087204487 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/alper/ Alper Çuğun Simit 2205837 z/lYS5T9anBp6xthoVO38A== https://c4.staticflickr.com/3/2932/14087204487... Hand,Pretzel 588173
47 /m/01f91_ Pretzel cfd9d474fcb239f6 freeform 1 0.029567000000000003 0.865542 0.093878 0.8897219999999999 0 ... https://www.flickr.com/photos/alper/14087204487 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/alper/ Alper Çuğun Simit 2205837 z/lYS5T9anBp6xthoVO38A== https://c4.staticflickr.com/3/2932/14087204487... Hand,Pretzel 588174
48 /m/035r7c Leg 855c656394d79d3b freeform 1 0.781742 1.0 0.5547350000000001 0.78125 0 ... https://www.flickr.com/photos/jimwhimpey/11704... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/jimwhimpey/ Jim Whimpey Massive Preztel 367042 jgcD8zaFGt96Ij1UaHHyng== https://c1.staticflickr.com/2/1015/1170431593_... Leg,Pretzel 594922
49 /m/01f91_ Pretzel 855c656394d79d3b freeform 1 0.155333 0.7915479999999999 0.14091900000000002 0.902115 0 ... https://www.flickr.com/photos/jimwhimpey/11704... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/jimwhimpey/ Jim Whimpey Massive Preztel 367042 jgcD8zaFGt96Ij1UaHHyng== https://c1.staticflickr.com/2/1015/1170431593_... Leg,Pretzel 594923
50 /m/09728 Bread 9029e6c5f0eb155b freeform 1 2.2E-5 1.0 0.0 1.0 0 ... https://www.flickr.com/photos/photokat/4935265412 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/photokat/ Mercury Jane Pretzels (Vegan Baking = Awesome!) 292582 cfpUnDG7V3YTmNtFMF/msQ== https://c1.staticflickr.com/5/4123/4935265412_... Bread,Doughnut,Pretzel 609594
51 /m/0jy4k Doughnut 9029e6c5f0eb155b freeform 1 1.68E-4 1.0 1.83E-4 1.0 0 ... https://www.flickr.com/photos/photokat/4935265412 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/photokat/ Mercury Jane Pretzels (Vegan Baking = Awesome!) 292582 cfpUnDG7V3YTmNtFMF/msQ== https://c1.staticflickr.com/5/4123/4935265412_... Bread,Doughnut,Pretzel 609595
52 /m/01f91_ Pretzel 9029e6c5f0eb155b freeform 1 0.0 1.0 0.0 0.999994 0 ... https://www.flickr.com/photos/photokat/4935265412 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/photokat/ Mercury Jane Pretzels (Vegan Baking = Awesome!) 292582 cfpUnDG7V3YTmNtFMF/msQ== https://c1.staticflickr.com/5/4123/4935265412_... Bread,Doughnut,Pretzel 609596
53 /m/09728 Bread a296a6d66069c4b7 freeform 1 9.7E-5 0.9999979999999999 2.7000000000000002E-5 0.9999979999999999 0 ... https://www.flickr.com/photos/ogimogi/2635600823 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ogimogi/ Eran Sandler These pretzels are making me thirsty 193794 LKk461KcJ3GN3oxy7/4YjA== https://c4.staticflickr.com/4/3270/2635600823_... Bread,Pretzel 609629
54 /m/01f91_ Pretzel a296a6d66069c4b7 freeform 1 0.0 1.0 0.0 0.9999469999999999 1 ... https://www.flickr.com/photos/ogimogi/2635600823 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ogimogi/ Eran Sandler These pretzels are making me thirsty 193794 LKk461KcJ3GN3oxy7/4YjA== https://c4.staticflickr.com/4/3270/2635600823_... Bread,Pretzel 609630
55 /m/09728 Bread c4ee1f7d62b0adaf freeform 1 0.017006999999999998 0.980835 0.031082 0.9987209999999999 0 ... https://www.flickr.com/photos/arndog/14243965679 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/arndog/ Arnold Gatilao Pretzel 90760 1PXDM2FbCtH5FWk05Q1Zyg== https://c7.staticflickr.com/6/5530/14243965679... Bread,Pretzel 609689
56 /m/01f91_ Pretzel c4ee1f7d62b0adaf freeform 1 0.016985 0.9826950000000001 0.035746 0.999866 0 ... https://www.flickr.com/photos/arndog/14243965679 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/arndog/ Arnold Gatilao Pretzel 90760 1PXDM2FbCtH5FWk05Q1Zyg== https://c7.staticflickr.com/6/5530/14243965679... Bread,Pretzel 609690
57 /m/01fb_0 Bagel 6432289be9c00e35 freeform 1 0.010722 1.0 0.036893 1.0 0 ... https://www.flickr.com/photos/slgc/5540367430 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/slgc/ slgckgc Day 78 - Food To Carb Up By 1078813 B+dhS5OsuEqIUI0CJt8U5A== https://c6.staticflickr.com/6/5214/5540367430_... Bagel,Pretzel 623671
58 /m/01f91_ Pretzel 6432289be9c00e35 freeform 1 0.011295 0.999801 0.037631 1.0 0 ... https://www.flickr.com/photos/slgc/5540367430 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/slgc/ slgckgc Day 78 - Food To Carb Up By 1078813 B+dhS5OsuEqIUI0CJt8U5A== https://c6.staticflickr.com/6/5214/5540367430_... Bagel,Pretzel 623672
59 /m/01f91_ Pretzel 064306279f03f571 freeform 1 0.101405 1.0 0.0 0.999884 0 ... https://www.flickr.com/photos/tahini/4104862505 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/tahini/ Mr Thinktank SDC10751 1001859 HItc7PJM3LacPqh9c9hQ2A== https://c5.staticflickr.com/3/2802/4104862505_... Pretzel 624480
60 /m/01f91_ Pretzel 0745af351683e689 freeform 1 0.137207 0.850242 0.017588 0.855876 0 ... https://www.flickr.com/photos/rodrigogalindez/... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/rodrigogalindez/ Rodrigo Galindez IMG_4259 164038 ZJ6MMsypsgTg6HLaGXB3Mg== https://c4.staticflickr.com/4/3071/2993372576_... Pretzel 624481
61 /m/01f91_ Pretzel 25072591e257c42a freeform 1 0.141828 0.752309 0.13637 0.826089 0 ... https://www.flickr.com/photos/ma-y/2388541538 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ma-y/ FrauSchütze Kraramell-Brezeln 75650 ZjAbdc+NlnZqZqwpJPGutQ== https://c1.staticflickr.com/3/2160/2388541538_... Pretzel 624482
62 /m/01f91_ Pretzel 7cbaa90f62aea35b freeform 1 4.7999999999999996E-4 0.999801 0.141652 0.670998 0 ... https://www.flickr.com/photos/78919492@N00/548... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/78919492@N00/ nimame メガネセバスチャンの誕生日を祝ってシュークリーム作ったよ！ 69409 Jl07QHIctrDnpZCngj6mNw== https://c5.staticflickr.com/6/5219/5485673390_... Pretzel 624483
63 /m/01f91_ Pretzel 8e164d1a6f6edbf4 freeform 1 5.809999999999999E-4 0.388308 0.018654 0.781555 1 ... https://www.flickr.com/photos/dottiemae/520447... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/dottiemae/ Jenn Durfey Pretzel 136203 K1+/lppJ75GLEWx+nDa2DQ== https://c5.staticflickr.com/6/5127/5204477134_... Pretzel 624484
64 /m/01f91_ Pretzel 8e164d1a6f6edbf4 freeform 1 0.018247 0.9722219999999999 0.091179 0.9975 0 ... https://www.flickr.com/photos/dottiemae/520447... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/dottiemae/ Jenn Durfey Pretzel 136203 K1+/lppJ75GLEWx+nDa2DQ== https://c5.staticflickr.com/6/5127/5204477134_... Pretzel 624485
65 /m/01f91_ Pretzel 8e164d1a6f6edbf4 freeform 1 0.185611 0.638424 5.23E-4 0.12186199999999998 1 ... https://www.flickr.com/photos/dottiemae/520447... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/dottiemae/ Jenn Durfey Pretzel 136203 K1+/lppJ75GLEWx+nDa2DQ== https://c5.staticflickr.com/6/5127/5204477134_... Pretzel 624486
66 /m/01f91_ Pretzel 8e164d1a6f6edbf4 freeform 1 0.47198999999999997 0.998333 0.001918 0.646269 1 ... https://www.flickr.com/photos/dottiemae/520447... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/dottiemae/ Jenn Durfey Pretzel 136203 K1+/lppJ75GLEWx+nDa2DQ== https://c5.staticflickr.com/6/5127/5204477134_... Pretzel 624487
67 /m/01f91_ Pretzel c34c317b12290dae freeform 1 0.208729 0.8385600000000001 0.24468499999999999 0.8498620000000001 0 ... https://www.flickr.com/photos/indi/8208004060 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/indi/ Indi Samarajiva Brezel at Work In Progress (WIP) 3773376 WSiFSe9/kde6Kdl/yaHBuw== https://c5.staticflickr.com/9/8342/8208004060_... Pretzel 624488
68 /m/01f91_ Pretzel d5f2dd2e152170b5 freeform 1 0.230366 0.694095 0.023332 0.994309 0 ... https://www.flickr.com/photos/oskay/412424611 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/oskay/ Windell Oskay Paragraphetzel 54650 KCP3a5cZ9zhUAvv9qstGPA== https://c5.staticflickr.com/1/185/412424611_95... Pretzel 624489
69 /m/01f91_ Pretzel fca16324b8ee40e0 freeform 1 0.002009 0.997991 0.0 0.9831780000000001 0 ... https://www.flickr.com/photos/overthetuscansto... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/overthetuscanstove/ judywitts Taralli grano arso 119485 Zof/gFDVkOrJNdosC/1jGQ== https://c5.staticflickr.com/1/332/19102451439_... Pretzel 624490

70 rows × 26 columns

Slice negative examples

In [23]:
notpretzel = """
select * from "frags_openimages_trainable-human-bbox"
where not contains(split(alldescriptionsforimageid, ',') , 'Pretzel')
order by rand()
limit 141;
"""

quilt3.query(notpretzel)
Out[23]:
labelname description imageid source confidence xmin xmax ymin ymax isoccluded ... originallandingurl license authorprofileurl author title originalsize originalmd5 thumbnail300kurl alldescriptionsforimageid __index_level_0__
0 /m/01g317 Person f07e1d32bde10700 freeform 1 0.383734 0.402129 0.041087 0.10192899999999999 0 ... https://www.flickr.com/photos/neeta_lind/21580... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/neeta_lind/ Neeta Lind 100_3736 159751 CBCeMBy8ki4oDfCofDPWHQ== https://c5.staticflickr.com/1/72/215808255_4c1... Person,Footwear,Arm,Leg 231423
1 /m/0hf58v5 Luggage and bags 3268431ea960dbc8 freeform 1 0.513922 0.981058 0.090018 0.4827 0 ... https://www.flickr.com/photos/seeminglee/87130... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/seeminglee/ See-ming Lee Lowepro Pro Roller x300 / SML Shopping Opinion... 529651 Qj5sJmoNNvcCHh/9E907sQ== https://c7.staticflickr.com/9/8267/8713061908_... Clothing,Wheel,Luggage and bags,Backpack,Suitcase 265368
2 /m/0c9ph5 Flower 2d10327e26b4efe9 freeform 1 0.619205 0.634612 0.936113 0.9816860000000001 1 ... https://www.flickr.com/photos/bluetigger/17037... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/bluetigger/ olaszmelo Sitting in the grass 659142 5fYc5h70gTMlBf6AqG56Cg== https://c3.staticflickr.com/1/38/170372817_9f5... Plant,Flower,Dog 396932
3 /m/04hgtk Head 3d520aaa20eba0b6 freeform 1 0.10391500000000001 0.150748 0.004803 0.077413 1 ... https://www.flickr.com/photos/remus/467571186 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/remus/ Remus Pereni Dog Shows 2007 3200486 KbtAAW3ta+sZWj+a1I8/mQ== https://c7.staticflickr.com/1/210/467571186_53... Person,Clothing,Face,Boy,Dog,Human body,Head,M... 63474
4 /m/01prls Land vehicle 3a219cd30903a59d freeform 1 0.925565 0.954792 0.463663 0.491638 0 ... https://www.flickr.com/photos/34822682@N00/798... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/34822682@N00/ Skinny Pete Deux DSC_0134-4.jpg 7782932 NCNgdaQcP7RoWzArwbsZZg== https://c8.staticflickr.com/9/8314/7989523174_... Vehicle,Land vehicle,Car,Wheel 431735
5 /m/0c9ph5 Flower 800ab3ee7d8d0eec freeform 1 0.432659 0.817159 0.188842 0.810661 0 ... https://www.flickr.com/photos/davidtng/5669951670 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/davidtng/ davidtng Ipomoea indica for GJ 77419 VEpVruxgKK9n/Dhm7cwP0A== https://c3.staticflickr.com/6/5021/5669951670_... Plant,Flower 405283
6 /m/083wq Wheel 4139fdeca75acc3c freeform 1 0.0 0.071984 0.529353 0.70535 1 ... https://www.flickr.com/photos/72637915@N03/152... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/72637915@N03/ ilikewaffles11 Porsche Cayenne Turbo 2370136 YnbLd9ZsfZKeHHk8OUnHxQ== https://c3.staticflickr.com/8/7577/15243111423... Land vehicle,Car,Wheel,Tire 462152
7 /m/03q69 Hair 70e5fd17d69dff14 freeform 1 0.149064 0.890709 5.45E-4 1.0 0 ... https://www.flickr.com/photos/ambigel/324948106 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ambigel/ Alexander Andrade linita 11654 Zlyl7jizcJ4wOQt1DBlASw== nan Clothing,Face,Woman,Girl,Human body,Hair,Head,... 283750
8 /m/02xwb Fruit a892ad2c03f2e7e5 freeform 1 0.991933 0.999167 0.611345 0.6226689999999999 1 ... https://www.flickr.com/photos/theogeo/2566525269 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/theogeo/ Lindsey Turner fruit 3791460 QoK9JckhD8OKnxlucevs2A== https://c7.staticflickr.com/4/3007/2566525269_... Tree,Food,Fruit 383636
9 /m/01g317 Person 9a32515ef0e2a1a5 freeform 1 0.125647 0.135295 0.278251 0.322856 0 ... https://www.flickr.com/photos/egizu/5464864964 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/egizu/ EGIZU Getxo Euskaldun Elkartea CIMG0005 1004488 Cxb3GrvS/tgIZroyDkIYGQ== https://c1.staticflickr.com/6/5173/5464864964_... Person,Footwear,Hiking equipment,Ski 151551
10 /m/0270h Dessert 74cbfabf13032b84 freeform 1 0.103625 0.897349 0.053674 0.840659 0 ... https://www.flickr.com/photos/wcowperthwaite/1... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/wcowperthwaite/ Wheeler Cowperthwaite IMG_2178 3752504 iO1ucpPPQZSybCeC64qoxg== https://c6.staticflickr.com/4/3854/14809162040... Dessert,Cookie 583291
11 /m/0270h Dessert a8949907429dea5b freeform 1 3.76E-4 1.0 2.68E-4 0.9973209999999999 0 ... https://www.flickr.com/photos/ucffool/5254735935 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ucffool/ UCFFool Gingerbread House tree 1 2407772 JnB9kml8tSKU2EK5Vk1sng== https://c4.staticflickr.com/6/5289/5254735935_... Dessert 583758
12 /m/01xgg_ Medical equipment 18a2842048453a33 freeform 1 0.0 1.0 0.0 0.999843 0 ... https://www.flickr.com/photos/armydre2008/4107... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/armydre2008/ frankieleon how many channels does it get? 311382 5+gDp1grY0thoCmFAap1TQ== https://c7.staticflickr.com/3/2745/4107321232_... Medical equipment 617317
13 /m/0k4j Car 4b360852c30c8173 freeform 1 0.35382199999999997 0.8093060000000001 0.42140299999999997 0.834801 0 ... https://www.flickr.com/photos/octal/340619934 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/octal/ Ryan Lackey h3 692248 kFbFvTCWKvVXspMmA//fTg== https://c1.staticflickr.com/1/166/340619934_36... Car,Wheel,Tire 491706
14 /m/0199g Bike 6e062f5035cecad3 freeform 1 0.0 0.9999030000000001 0.0 0.917668 0 ... https://www.flickr.com/photos/ansik/2509297004 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ansik/ Anssi Koskinen rautaa_asemalla_20080517-PICT23660.jpg 3485940 dc35fH5TUzyz/nZjs0GGaw== https://c2.staticflickr.com/4/3097/2509297004_... Wheel,Tire,Bike,Bicycle wheel 533502
15 /m/09j5n Footwear a27b514f8f560162 freeform 1 0.445275 0.476179 0.661384 0.7128899999999999 0 ... https://www.flickr.com/photos/ndvision/4595592594 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ndvision/ diego nobile DSCF7010 808834 Ufa9PtG9sXedMcT6Byb32w== https://c2.staticflickr.com/4/3353/4595592594_... Woman,Footwear,Mammal 422686
16 /m/01g317 Person a70436e97423f1c5 freeform 1 0.375359 0.47526599999999997 0.422278 0.881814 0 ... https://www.flickr.com/photos/superchango/4567... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/superchango/ Maarten DSC_0115 3003171 w5OIT0oab6YEyfDYCP8jrA== https://c5.staticflickr.com/5/4056/4567672593_... Person,Airplane 163592
17 /m/01h3n Bee 0dc816c9cd4fce12 freeform 1 0.411666 0.5166390000000001 0.468292 0.600892 1 ... https://www.flickr.com/photos/72508087@N00/873... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/72508087@N00/ holmesjtg DSCN1618 6209132 cyunXfLEfocqChl78JV7UQ== https://c4.staticflickr.com/8/7320/8734033288_... Plant,Flower,Bee 393457
18 /m/03k3r Horse 39cce790b1b2e343 freeform 1 0.373646 1.0 0.10012599999999999 0.8936139999999999 0 ... https://www.flickr.com/photos/winnie_pix/15198... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/winnie_pix/ Winniepix The ploughman and the shire horse 1065162 E/r2VOIVShqH8SHnIgOPrg== https://c1.staticflickr.com/4/3885/15198395528... Human body,Hair,Head,Mammal,Mouth,Horse 559661
19 /m/0388q Grape 8c52f1e6710ee0ee freeform 1 0.300818 0.583231 0.186611 0.8957120000000001 1 ... https://www.flickr.com/photos/ephoto/47034662 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/ephoto/ E Photos Grape Vines 145528 lOGh4n2p0I6qFwU60G6vEw== https://c1.staticflickr.com/1/26/47034662_7db3... Plant,Fruit,Grape 406548
20 /m/01g317 Person eef9af2d48b05456 freeform 1 0.0 0.775544 0.013308 1.0 1 ... https://www.flickr.com/photos/x1brett/8699034158 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/x1brett/ brett jordan Tim Buckley 954078 hIzQYOhavC4lRX2gxfkx9w== https://c5.staticflickr.com/9/8543/8699034158_... Person,Tie,Violin 229942
21 /m/0dzct Face b4b058e29fdbe65d freeform 1 0.407473 0.595263 0.18928399999999998 0.685126 0 ... https://www.flickr.com/photos/john14/3355114127 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/john14/ ConfutatisMaledictis! Tres Cabezas de La Gloriosa 3644762 9F8Y7H8nYj0Jn+wi8WtzBg== https://c7.staticflickr.com/4/3591/3355114127_... Face,Woman,Fashion accessory,Hair,Nose,Eye 362559
22 /m/035r7c Leg e0a183ec19225125 freeform 1 0.269314 0.510077 0.702499 0.9788209999999999 0 ... https://www.flickr.com/photos/pro-juventute/10... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/pro-juventute/ Pro Juventute Pro Juventute Aufklärungskampagne ‚Sexting’ Pl... 1495380 NpAA8Y46wCTMRUpkoG3xAA== https://c8.staticflickr.com/3/2829/10592640616... Clothing,Woman,Girl,Human body,Hair,Head,Arm,N... 314172
23 /m/083wq Wheel 577fab19e6e9312a freeform 1 0.856168 0.895459 0.0010710000000000001 0.082166 0 ... https://www.flickr.com/photos/uniform-studio/3... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/uniform-studio/ Martha W McQuade best bike 2615411 8/oWxjqQH4mtl2EmoGhfPQ== https://c3.staticflickr.com/4/3327/3626757869_... Land vehicle,Wheel,Tire,Bike,Bicycle wheel 463558
24 /m/09j2d Clothing fb95b3f8cf29b596 freeform 1 0.20188699999999998 0.402217 0.305614 0.74756 0 ... https://www.flickr.com/photos/jeffpearce/20484... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/jeffpearce/ Jeff Pearce IMG_6962 161799 bNVrcV0HJDvBubecIENmVw== https://c7.staticflickr.com/3/2142/2048437745_... Person,Clothing,Man,Plant,Footwear,Helmet 242773
25 /m/06msq Sculpture 051945e19cd6622c freeform 1 0.122772 0.812331 0.021800999999999997 1.0 0 ... https://www.flickr.com/photos/anandajoti/91053... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/anandajoti/ Photo Dharma 015 Ji-Gong-Huo-Fo 3698499 x8HAQEl6DwArrQdVnIImwQ== https://c6.staticflickr.com/4/3668/9105370988_... Person,Face,Human body,Head,Sculpture,Nose,Eye... 5626
26 /m/01g317 Person 39f33e6bf34e6e3e freeform 1 0.6196 1.0 0.232496 0.827541 0 ... https://www.flickr.com/photos/irulan_amy/16407... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/irulan_amy/ Amy Gamora Sixth Scale Figure by Hot Toys 206055 pF1m7FMtXGIhKwjylFPJjw== https://c8.staticflickr.com/8/7374/16407674748... Person,Clothing 59995
27 /m/08pbxl Monkey 827718c669b3e1a7 freeform 1 0.17066900000000002 0.719403 0.146169 1.0 0 ... https://www.flickr.com/photos/jo_ma/7143702893 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/jo_ma/ José e Marina Macaco 140427 JCIfFJa3atYAFr/XskfCNw== https://c1.staticflickr.com/8/7064/7143702893_... Monkey 607787
28 /m/09j2d Clothing 59aa3c2e75337c53 freeform 1 0.5698 0.668241 0.108707 0.180099 1 ... https://www.flickr.com/photos/tripletri/352586... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/tripletri/ switz1873 IMG_0502 695805 sf2wZv+dN7JvaeA6/kbMog== https://c2.staticflickr.com/4/3358/3525868144_... Person,Clothing,Man,Arm,Sports uniform,Basebal... 90010
29 /m/0270h Dessert 0d2e9ff65d59e5aa freeform 1 0.0 1.0 0.053674 0.9501299999999999 0 ... https://www.flickr.com/photos/zereth/2170291750 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/zereth/ zerethv Rosca de reyes 122959 Cvy/KhixPPUmDEXzMyXt/Q== https://c6.staticflickr.com/3/2130/2170291750_... Baked goods,Dessert 576194
... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...
111 /m/0dzf4 Arm 3a5f6fa58fce0f61 freeform 1 0.518177 0.613041 0.250949 0.297284 1 ... https://www.flickr.com/photos/malcolmslaney/16... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/malcolmslaney/ Malcolm Slaney Jasper launching 4130283 qM/3lbAtu2bop8h47NTvsQ== https://c4.staticflickr.com/9/8732/16270824083... Person,Man,Footwear,Human body,Arm,Hand,Leg 60394
112 /m/01g317 Person 36f29ffcb961c7d1 freeform 1 0.041818 0.20981799999999998 0.597694 0.960775 0 ... https://www.flickr.com/photos/58159060@N06/964... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/58159060@N06/ Poppybead The Paras Becks 365 211142 WuIi0ZqY8vKdAOLSYTwxuw== https://c4.staticflickr.com/6/5502/9647227983_... Person,Clothing,Footwear,Arm,Hand,Wheelchair 56531
113 /m/03q69 Hair 9eefcd7d1c3b4a51 freeform 1 0.620794 0.676902 0.326 0.39318200000000003 1 ... https://www.flickr.com/photos/bozdoz/5007663315 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/bozdoz/ Benjamin J. DeLong Running Blonde 630801 yGHKNprwyNxR/zIwmr4skw== https://c8.staticflickr.com/5/4112/5007663315_... Person,Clothing,Woman,Footwear,Girl,Human body... 156114
114 /m/04rky Mammal 3647b85f77c58b72 freeform 1 0.211808 0.689589 0.010211 0.941908 1 ... https://www.flickr.com/photos/gowestphoto/3922... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/gowestphoto/ Tsutomu Takasu KIRIN Challenge Cup 208998 OxfGeK89dT80dnENPBo4nQ== https://c2.staticflickr.com/4/3429/3922491766_... Man,Sports equipment,Hair,Head,Mammal,Arm,Hand... 327581
115 /m/0174k2 Washing machine 8f75097c4496782e freeform 1 0.0 1.0 0.115273 1.0 0 ... https://www.flickr.com/photos/osseous/16309705533 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/osseous/ osseous November 13, 2014 4038186 h6LtsFMqyqxIpFPpYlzrtQ== https://c1.staticflickr.com/9/8698/16309705533... Washing machine 623339
116 /m/0h9mv Tire 15d668614ad67109 freeform 1 0.847874 0.8712110000000001 0.66266 0.70497 0 ... https://www.flickr.com/photos/widnes_road/1482... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/widnes_road/ Paul Smith Pistonheads AMG C63 Owners meet @ Topcats Racing 5163124 b1+xEcTmaVe6y+uBFPbbFQ== https://c5.staticflickr.com/4/3876/14824773799... Vehicle,Car,Wheel,Tire,Arm 427794
117 /m/01z1kdw Juice faeda29ba3a7cfc1 freeform 1 0.8188529999999999 0.999877 0.529329 0.8487239999999999 0 ... https://www.flickr.com/photos/duffbert/2087717... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/duffbert/ Thomas Duff Started with the Tikitastic... 86671 0/pTUetTWBcxLGOblHUcvg== https://c4.staticflickr.com/1/657/20877171934_... Drink,Cocktail,Juice 563659
118 /m/0dzf4 Arm 1f1293274a27e41e freeform 1 0.076567 0.23082199999999997 0.359257 0.665813 0 ... https://www.flickr.com/photos/usfwshq/15546633778 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/usfwshq/ U.S. Fish and Wildlife Service Headquarters Visiting Professors - ODWIM 5570492 o+igt/Qqz0DAlwphnvgrRw== https://c6.staticflickr.com/8/7518/15546633778... Person,Clothing,Furniture,Human body,Arm,Micro... 33143
119 /m/0cgh4 Building 75d6a6725a7e0516 freeform 1 0.0 1.0 0.0 1.0 0 ... https://www.flickr.com/photos/europedistrict/5... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/europedistrict/ U.S. Army Corps of Engineers Europe District USACE, K-Town community celebrate opening of c... 2114053 9kjb4LN4m4UB2hxAxpLnxA== https://c6.staticflickr.com/6/5068/5679294322_... Building,Furniture,Toy,Shelf 454034
120 /m/01g317 Person 0c34a2f75a195db1 freeform 1 0.0 0.8739610000000001 0.137 0.56743 0 ... https://www.flickr.com/photos/pfenwick/4912676063 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/pfenwick/ Paul Fenwick Manifest 2010 3041977 xq4z/Jtf4xlzOvogPp5M2A== https://c8.staticflickr.com/5/4138/4912676063_... Person,Clothing,Man,Footwear,Girl,Human body,J... 13662
121 /m/01g317 Person 0d98d0cea52c9f52 freeform 1 0.128691 0.193049 0.478625 0.717731 0 ... https://www.flickr.com/photos/randa/2996429951 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/randa/ Rick Cooper Nevada Day 2008 257993 3tMFQfF0XqcbP22LCnsWqg== https://c2.staticflickr.com/4/3275/2996429951_... Person,Head,Mammal,Horse,Mule 15450
122 /m/03q69 Hair 80a505dbf4956c78 freeform 1 0.779889 0.872555 0.8562549999999999 0.994359 0 ... https://www.flickr.com/photos/univers-finder/1... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/univers-finder/ 陈文 IMGP2323 5834396 Hhjn/8eNKHl4lHjAqw1D9g== https://c8.staticflickr.com/3/2884/10910529216... Person,Hair,Head,Nose,Mouth,Racket 127057
123 /m/09j2d Clothing c641848329ca8984 freeform 1 0.46898199999999995 0.5722 0.48644799999999994 0.648247 0 ... https://www.flickr.com/photos/togasaki/2368084284 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/togasaki/ John Togasaki Prim and proper 1066551 kbGGlQOuJLJvwct5jW28Lw== https://c3.staticflickr.com/3/2299/2368084284_... Person,Clothing,Footwear,Sports equipment,Racket 191652
124 /m/05s2s Plant a434ac33602740dd freeform 1 0.749837 1.0 0.314244 0.6390319999999999 0 ... https://www.flickr.com/photos/aon/6275135978 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/aon/ angela n. East Dorset, VT 2345645 mu+PiU+x4NUzYtKxLpzJZw== https://c4.staticflickr.com/7/6041/6275135978_... Tree,Plant,Chest of drawers 383107
125 /m/079cl Skyscraper e11fd10224638861 freeform 1 3.5E-5 0.113863 0.850852 1.0 1 ... https://www.flickr.com/photos/35558490@N08/842... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/35558490@N08/ Wassrcw 300113b 7181153 S1nKZHalyqf9vC5dmtrqtA== https://c7.staticflickr.com/9/8226/8428776082_... Skyscraper 571166
126 /m/083wq Wheel 121a03439248fbc7 freeform 1 0.43149899999999997 0.631208 0.590749 0.9714440000000001 1 ... https://www.flickr.com/photos/katescars/739477... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/katescars/ Katherine Tompkins 1950 Ford F-47 94411 1ZmDODwaFp9QlJKnXYilFw== nan Car,Wheel,Truck 483872
127 /m/05s2s Plant d3fc8a4f5718f7f2 freeform 1 0.8939959999999999 0.99777 0.627026 0.8379709999999999 0 ... https://www.flickr.com/photos/131610435@N05/16... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/131610435@N05/ k.giac Untitled 8108337 9/cei7qAb046Io2TjtGDkg== https://c2.staticflickr.com/8/7614/16174508724... Plant 413387
128 /m/09j5n Footwear ba3d7c942ce9f1e1 freeform 1 0.6957220000000001 0.937425 0.21425 0.866265 0 ... https://www.flickr.com/photos/modomatic/295276... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/modomatic/ Mo Riza Stiff Feet 194114 6yBM1HC16z0En1bJpfg//A== https://c5.staticflickr.com/4/3231/2952764095_... Footwear 477486
129 /m/0k65p Hand 038e6d79ac8c033e freeform 1 0.191922 0.45813100000000007 0.798179 0.996337 0 ... https://www.flickr.com/photos/nagillum/1444579876 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/nagillum/ Peter Mulligan Buddhist monk 534907 NTCVyJQl1L3IWY9BVXFtxQ== https://c1.staticflickr.com/2/1009/1444579876_... Person,Clothing,Human body,Hand 4082
130 /m/07yv9 Vehicle c2bf8f3187f27c47 freeform 1 0.8180029999999999 1.0 0.43418599999999996 0.5134920000000001 1 ... https://www.flickr.com/photos/angryjuliemonday... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/angryjuliemonday/ AngryJulieMonday Said goodbye to my eight year old Tahoe today.... 86150 NZUuU3LSf1wGETYXkVs9uQ== https://c8.staticflickr.com/9/8865/18629342621... Vehicle,Car,Wheel,Tire 445731
131 /m/0bh9flk Tablet computer 229229d66b7f3e6c freeform 1 0.015986 0.985934 0.009726 0.985081 0 ... https://www.flickr.com/photos/elenizazani/8478... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/elenizazani/ Eleni How to interact with #Edcmchat 267816 LHYPz12BMCWA+EOl345dgg== https://c7.staticflickr.com/9/8246/8478552684_... Tablet computer 614943
132 /m/0463sg Fashion accessory b4bbb0930718fe3d freeform 1 0.477526 0.569825 0.127127 0.185844 0 ... https://www.flickr.com/photos/claudiogennari/3... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/claudiogennari/ Claudio Gennari Grand prix equestrian all'ippodromo of Capanne... 166250 IVQvfDoemp9oPPtqSmQ6JQ== https://c7.staticflickr.com/4/3637/3516751860_... Person,Clothing,Fashion accessory,Mammal,Helme... 176740
133 /m/01prls Land vehicle 78cf7531c1c2c197 freeform 1 0.0 0.165881 0.126388 0.20748000000000003 1 ... https://www.flickr.com/photos/tinto/14810502148 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/tinto/ Jörg Schubert Car Freitag 7212367 ksSh+UEe80O1ePPhLOPJog== https://c2.staticflickr.com/4/3888/14810502148... Land vehicle,Car 465445
134 /m/01g317 Person 132984afdbbdfe6a freeform 1 0.076257 0.180576 0.342146 0.7944140000000001 1 ... https://www.flickr.com/photos/nlcwood/8532129044 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/nlcwood/ New Life Church Collingwood 54_DSC00326 157847 YNcGvyfTPWcAAfu2ul3ivg== https://c2.staticflickr.com/9/8366/8532129044_... Person,Clothing,Footwear,Human body,Arm 20544
135 /m/09j2d Clothing 56c551bb0e13d803 freeform 1 0.0 0.203317 0.317752 0.881799 1 ... https://www.flickr.com/photos/hollywoodbranded... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/hollywoodbranded/ Hollywood Branded IMG_0403 1097073 bHhAsXHwS0zZJ6rm3gXQNA== https://c5.staticflickr.com/4/3692/14120476829... Person,Clothing,Woman,Girl,Food,Head,Fast food 87332
136 /m/03p3bw Bicycle helmet 93f7d390a622ecd5 freeform 1 0.221771 0.230475 0.40767800000000004 0.427623 0 ... https://www.flickr.com/photos/83015819@N00/358... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/83015819@N00/ Jon Worth Skaters at hairpin 4422496 UASVoFOK6xc2qb7lgJFqdg== https://c2.staticflickr.com/4/3334/3581048857_... Person,Footwear,Sports equipment,Bicycle helme... 145643
137 /m/01g317 Person cc0f5fc9a3d76799 freeform 1 0.356692 0.64912 0.352329 0.734527 0 ... https://www.flickr.com/photos/michael-dunn/357... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/michael-dunn/ slayermd AMA Racer Jason DiSalvo at Pueblo Colorado 3026848 s1PdfttiPzeMPTfs0pb5EA== https://c2.staticflickr.com/4/3603/3572010812_... Person,Helmet,Motorcycle 197310
138 /m/050k8 Mobile phone 394df68605f8361e freeform 1 0.624003 0.91648 0.922256 1.0 1 ... https://www.flickr.com/photos/gillyberlin/6331... https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/gillyberlin/ GillyBerlin Blogger @ Work 1427205 LxqAaYdpoz9lhYmOMDiGxQ== https://c4.staticflickr.com/7/6231/6331364425_... Clothing,Human body,Arm,Mobile phone,Headphones 267951
139 /m/03bt1vf Woman 642ed46123790697 freeform 1 0.377405 0.670431 0.36130500000000004 1.0 0 ... https://www.flickr.com/photos/paulk/4816786128 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/paulk/ Paul Keller tamara 4751720 KH04n5quW35xkmRevDwd7w== https://c6.staticflickr.com/5/4135/4816786128_... Clothing,Face,Woman,Building,Girl,Hair,Arm,Boo... 280532
140 /m/04yx4 Man 6b99760f0923ea9a freeform 1 0.0 0.415191 0.362294 1.0 1 ... https://flickr.com/53488242@N04/6982020697 https://creativecommons.org/licenses/by/2.0/ https://www.flickr.com/people/patashley/ Patrick Ashley Dave Brubeck &quot;Take Five&quot; 81910 4jSUijleuflNUFgMplNIdQ== nan Man,Face,Human body,Hair,Head,Nose,Eye,Mouth,S... 333481

141 rows × 26 columns

Deserialize data

In [27]:
quilt.install("akarve/BSDS300")

Downloading package metadata...
akarve/BSDS300 already installed.
Overwrite? (y/n) n
In [12]:
from quilt.data.akarve import BSDS300 as bsd
from quilt.asa.img import plot

bsd.images.test(asa=plot(figsize=(20, 20)))

<Figure size 432x288 with 0 Axes>
from quilt.data.akarve import BSDS300 as bsd
from quilt.asa.pytorch import dataset

my_dataset = pkg.mixed.img(asa=dataset(
    include=is_image,
    node_parser=node_parser,
    input_transform=input_transform(crop_size, upscale_factor),
    target_transform=target_transform(crop_size)
))

Rehydrate model

Sharing trained models, saves billions of CPU cycles

label free prediction

In [32]:
quilt.install("aics/label_free")
from quilt.data.aics import label_free

Downloading package metadata...

  0%|          | 0.00/1.69G [00:00<?, ?B/s]
Downloading 19 fragments (1686754100 bytes before compression)...

100%|██████████| 1.69G/1.69G [03:35<00:00, 7.81MB/s]
In [27]:
label_free
Out[27]:
<GroupNode>
dna/
fibrillarin/
lamin_b1/
membrane/
sec61_beta/
tom20/
README
import fnet
dna_serialized = label_free.dna.model()
dna_model = fnet.fnet_model.Model(dna_serialized)

# handle your input image here

prediction = dna_model.predict(input_image)

Wrap Up

Open science should expose the entire pipeline

aics pipeline

Quilt covers four bases

Internal External
Prototype data ✓ ✓
Production data ✓ ✓

Recommendations

  • Version your data + models
  • Build pipelines from reusable building blocks

Design guidelines

  • immutable package instances
  • distributed blob storage layer
  • de-duplicate repeated fragments via hash tree

Architecture

  • Compiler - build
    • pandas, pyarrow
  • Registry - index, permission
    • flask, sqlalchemy
  • Catalog - search, browse
    • react, redux

https://www.allencell.org/programmatic-data-access.html

https://blog.jupyter.org/reproducible-data-dependencies-for-python-guest-post-d0f68293a99

Questions?