Organism

lamindb provides access to the following public Organism ontologies through bionty:

  1. Ensembl Species

  2. NCBI Taxonomy

Here we show how to access and search Organism ontologies to standardize new data.

import bionty as bt
import pandas as pd

PublicOntology objects

Let us create a public ontology accessor with .public method, which chooses a default public ontology source from Source. It’s a PublicOntology object, which you can think about as a public registry:

organisms = bt.Organism.public(organism="vertebrates")
organisms
 connected lamindb: testuser1/test-public-ontologies
PublicOntology
Entity: Organism
Organism: vertebrates
Source: ensembl, release-112
#terms: 324

As for registries, you can export the ontology as a DataFrame:

df = organisms.df()
df.head()
scientific_name division ontology_id assembly assembly_accession genebuild variation microarray pan_compara peptide_compara genome_alignments other_alignments core_db species_id
name
spiny chromis acanthochromis_polyacanthus EnsemblVertebrates NCBITaxon:80966 ASM210954v1 GCA_002109545.1 2018-05-Ensembl/2020-03 N N N Y Y Y acanthochromis_polyacanthus_core_112_1 1
eurasian sparrowhawk accipiter_nisus EnsemblVertebrates NCBITaxon:211598 Accipiter_nisus_ver1.0 GCA_004320145.1 2019-07-Ensembl/2019-09 N N N N N Y accipiter_nisus_core_112_1 1
giant panda ailuropoda_melanoleuca EnsemblVertebrates NCBITaxon:9646 ASM200744v2 GCA_002007445.2 2020-05-Ensembl/2020-06 N N N Y Y Y ailuropoda_melanoleuca_core_112_2 1
yellow-billed parrot amazona_collaria EnsemblVertebrates NCBITaxon:241587 ASM394721v1 GCA_003947215.1 2019-07-Ensembl/2019-09 N N N N N Y amazona_collaria_core_112_1 1
midas cichlid amphilophus_citrinellus EnsemblVertebrates NCBITaxon:61819 Midas_v5 GCA_000751415.1 2018-05-Ensembl/2018-07 N N N Y Y Y amphilophus_citrinellus_core_112_5 1

Unlike registries, you can also export it as a Pronto object via public.ontology.

Look up terms

As for registries, terms can be looked up with auto-complete:

lookup = organisms.lookup()

The . accessor provides normalized terms (lower case, only contains alphanumeric characters and underscores):

lookup.giant_panda
Organism(name='giant panda', scientific_name='ailuropoda_melanoleuca', division='EnsemblVertebrates', ontology_id='NCBITaxon:9646', assembly='ASM200744v2', assembly_accession='GCA_002007445.2', genebuild='2020-05-Ensembl/2020-06', variation='N', microarray='N', pan_compara='N', peptide_compara='Y', genome_alignments='Y', other_alignments='Y', core_db='ailuropoda_melanoleuca_core_112_2', species_id=1)

To look up the exact original strings, convert the lookup object to dict and use the [] accessor:

lookup_dict = lookup.dict()
lookup_dict["giant panda"]
Organism(name='giant panda', scientific_name='ailuropoda_melanoleuca', division='EnsemblVertebrates', ontology_id='NCBITaxon:9646', assembly='ASM200744v2', assembly_accession='GCA_002007445.2', genebuild='2020-05-Ensembl/2020-06', variation='N', microarray='N', pan_compara='N', peptide_compara='Y', genome_alignments='Y', other_alignments='Y', core_db='ailuropoda_melanoleuca_core_112_2', species_id=1)

By default, the name field is used to generate lookup keys. You can specify another field to look up:

lookup = organisms.lookup(organisms.scientific_name)
lookup.ailuropoda_melanoleuca
Organism(name='giant panda', scientific_name='ailuropoda_melanoleuca', division='EnsemblVertebrates', ontology_id='NCBITaxon:9646', assembly='ASM200744v2', assembly_accession='GCA_002007445.2', genebuild='2020-05-Ensembl/2020-06', variation='N', microarray='N', pan_compara='N', peptide_compara='Y', genome_alignments='Y', other_alignments='Y', core_db='ailuropoda_melanoleuca_core_112_2', species_id=1)

Search terms

Search behaves in the same way as it does for registries:

organisms.search("rabbit").head(3)
name scientific_name division assembly assembly_accession genebuild variation microarray pan_compara peptide_compara genome_alignments other_alignments core_db species_id
ontology_id
NCBITaxon:9986 rabbit oryctolagus_cuniculus EnsemblVertebrates OryCun2.0 GCA_000003625.1 2009-11-Ensembl/2019-05 N Y N Y Y Y oryctolagus_cuniculus_core_112_2 1

By default, search also covers synonyms and all other fileds containing strings:

organisms.search("sapiens").head(3)
name scientific_name division assembly assembly_accession genebuild variation microarray pan_compara peptide_compara genome_alignments other_alignments core_db species_id
ontology_id
NCBITaxon:9606 human homo_sapiens EnsemblVertebrates GRCh38.p14 GCA_000001405.29 2014-01-Ensembl/2023-12 Y Y Y Y Y Y homo_sapiens_core_112_38 1

Search specific field (by default, search is done on all fields containing strings):

organisms.search(
    "oryctolagus_cuniculus",
    field=organisms.scientific_name,
).head()
name scientific_name division assembly assembly_accession genebuild variation microarray pan_compara peptide_compara genome_alignments other_alignments core_db species_id
ontology_id
NCBITaxon:9986 rabbit oryctolagus_cuniculus EnsemblVertebrates OryCun2.0 GCA_000003625.1 2009-11-Ensembl/2019-05 N Y N Y Y Y oryctolagus_cuniculus_core_112_2 1

Standardize Organism identifiers

Let us generate a DataFrame that stores a number of Organism identifiers, some of which corrupted:

df_orig = pd.DataFrame(
    index=[
        "spiny chromis",
        "silver-eye",
        "platyfish",
        "california sea lion",
        "This organism does not exist",
    ]
)
df_orig
spiny chromis
silver-eye
platyfish
california sea lion
This organism does not exist

We can check whether any of our values are validated against the ontology reference:

validated = organisms.validate(df_orig.index, organisms.name)
df_orig.index[~validated]
! 1 unique term (20.00%) is not validated: 'This organism does not exist'
Index(['This organism does not exist'], dtype='object')

Ontology source versions

For any given entity, we can choose from a number of versions:

bt.Source.filter(entity="bionty.Organism").df()
Hide code cell output
uid entity organism name in_db currently_used description url md5 source_website space_id dataframe_artifact_id version run_id created_at created_by_id _aux _branch_code
id
1 33TUF039 bionty.Organism vertebrates ensembl False True Ensembl https://ftp.ensembl.org/pub/release-112/specie... 0ec37e77f4bc2d0b0b47c6c62b9f122d https://www.ensembl.org 1 None release-112 None 2025-02-24 09:30:12.017000+00:00 1 None 1
2 1SRHUSrR bionty.Organism vertebrates ensembl False False Ensembl https://ftp.ensembl.org/pub/release-111/specie... 2846df83899eaa61f8043db4c036e883 https://www.ensembl.org 1 None release-111 None 2025-02-24 09:30:12.017000+00:00 1 None 1
3 6I0P1oNf bionty.Organism vertebrates ensembl False False Ensembl https://ftp.ensembl.org/pub/release-110/specie... f3faf95648d3a2b50fd3625456739706 https://www.ensembl.org 1 None release-110 None 2025-02-24 09:30:12.017000+00:00 1 None 1
4 2m0Dw0g3 bionty.Organism vertebrates ensembl False False Ensembl https://ftp.ensembl.org/pub/release-109/specie... 7595bb989f5fec07eaca5e2138f67bd4 https://www.ensembl.org 1 None release-109 None 2025-02-24 09:30:12.017000+00:00 1 None 1
5 7MMdg2Q0 bionty.Organism vertebrates ensembl False False Ensembl https://ftp.ensembl.org/pub/release-108/specie... d97c1ee302e4072f5f5c7850eff0b642 https://www.ensembl.org 1 None release-108 None 2025-02-24 09:30:12.017000+00:00 1 None 1
6 6bbVUTCS bionty.Organism bacteria ensembl False True Ensembl https://ftp.ensemblgenomes.ebi.ac.uk/pub/bacte... ee28510ed5586ea7ab4495717c96efc8 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
7 6s9nV6xh bionty.Organism fungi ensembl False True Ensembl http://ftp.ensemblgenomes.org/pub/fungi/releas... dbcde58f4396ab8b2480f7fe9f83df8a https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
8 2PmTrc8x bionty.Organism metazoa ensembl False True Ensembl http://ftp.ensemblgenomes.org/pub/metazoa/rele... 424636a574fec078a61cbdddb05f9132 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
9 7GPHh16S bionty.Organism plants ensembl False True Ensembl https://ftp.ensemblgenomes.ebi.ac.uk/pub/plant... eadaa1f3e527e4c3940c90c7fa5c8bf4 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
10 4tsksCMX bionty.Organism all ncbitaxon False True NCBItaxon Ontology s3://bionty-assets/df_all__ncbitaxon__2023-06-... 00d97ba65627f1cd65636d2df22ea76c https://github.com/obophenotype/ncbitaxon 1 None 2023-06-20 None 2025-02-24 09:30:12.017000+00:00 1 None 1
# only lists the sources that are currently used
bt.Source.filter(entity="bionty.Organism", currently_used=True).df()
uid entity organism name in_db currently_used description url md5 source_website space_id dataframe_artifact_id version run_id created_at created_by_id _aux _branch_code
id
1 33TUF039 bionty.Organism vertebrates ensembl False True Ensembl https://ftp.ensembl.org/pub/release-112/specie... 0ec37e77f4bc2d0b0b47c6c62b9f122d https://www.ensembl.org 1 None release-112 None 2025-02-24 09:30:12.017000+00:00 1 None 1
6 6bbVUTCS bionty.Organism bacteria ensembl False True Ensembl https://ftp.ensemblgenomes.ebi.ac.uk/pub/bacte... ee28510ed5586ea7ab4495717c96efc8 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
7 6s9nV6xh bionty.Organism fungi ensembl False True Ensembl http://ftp.ensemblgenomes.org/pub/fungi/releas... dbcde58f4396ab8b2480f7fe9f83df8a https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
8 2PmTrc8x bionty.Organism metazoa ensembl False True Ensembl http://ftp.ensemblgenomes.org/pub/metazoa/rele... 424636a574fec078a61cbdddb05f9132 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
9 7GPHh16S bionty.Organism plants ensembl False True Ensembl https://ftp.ensemblgenomes.ebi.ac.uk/pub/plant... eadaa1f3e527e4c3940c90c7fa5c8bf4 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
10 4tsksCMX bionty.Organism all ncbitaxon False True NCBItaxon Ontology s3://bionty-assets/df_all__ncbitaxon__2023-06-... 00d97ba65627f1cd65636d2df22ea76c https://github.com/obophenotype/ncbitaxon 1 None 2023-06-20 None 2025-02-24 09:30:12.017000+00:00 1 None 1

When instantiating a Bionty object, we can choose a source or version:

source = bt.Source.filter(
    name="ensembl", version="release-110", organism="vertebrates"
).one()
organisms= bt.Organism.public(source=source)
organisms
PublicOntology
Entity: Organism
Organism: vertebrates
Source: ensembl, release-110
#terms: 317

The currently used ontologies can be displayed using:

bt.Source.filter(currently_used=True).df()
Hide code cell output
uid entity organism name in_db currently_used description url md5 source_website space_id dataframe_artifact_id version run_id created_at created_by_id _aux _branch_code
id
1 33TUF039 bionty.Organism vertebrates ensembl False True Ensembl https://ftp.ensembl.org/pub/release-112/specie... 0ec37e77f4bc2d0b0b47c6c62b9f122d https://www.ensembl.org 1 None release-112 None 2025-02-24 09:30:12.017000+00:00 1 None 1
6 6bbVUTCS bionty.Organism bacteria ensembl False True Ensembl https://ftp.ensemblgenomes.ebi.ac.uk/pub/bacte... ee28510ed5586ea7ab4495717c96efc8 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
7 6s9nV6xh bionty.Organism fungi ensembl False True Ensembl http://ftp.ensemblgenomes.org/pub/fungi/releas... dbcde58f4396ab8b2480f7fe9f83df8a https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
8 2PmTrc8x bionty.Organism metazoa ensembl False True Ensembl http://ftp.ensemblgenomes.org/pub/metazoa/rele... 424636a574fec078a61cbdddb05f9132 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
9 7GPHh16S bionty.Organism plants ensembl False True Ensembl https://ftp.ensemblgenomes.ebi.ac.uk/pub/plant... eadaa1f3e527e4c3940c90c7fa5c8bf4 https://www.ensembl.org 1 None release-57 None 2025-02-24 09:30:12.017000+00:00 1 None 1
10 4tsksCMX bionty.Organism all ncbitaxon False True NCBItaxon Ontology s3://bionty-assets/df_all__ncbitaxon__2023-06-... 00d97ba65627f1cd65636d2df22ea76c https://github.com/obophenotype/ncbitaxon 1 None 2023-06-20 None 2025-02-24 09:30:12.017000+00:00 1 None 1
11 4UGNz3fr bionty.Gene human ensembl False True Ensembl s3://bionty-assets/df_human__ensembl__release-... 4ccda4d88720a326737376c534e8446b https://www.ensembl.org 1 None release-112 None 2025-02-24 09:30:12.017000+00:00 1 None 1
15 4r4fvV0S bionty.Gene mouse ensembl False True Ensembl s3://bionty-assets/df_mouse__ensembl__release-... 519cf7b8acc3c948274f66f3155a3210 https://www.ensembl.org 1 None release-112 None 2025-02-24 09:30:12.017000+00:00 1 None 1
19 4RPA3Re0 bionty.Gene saccharomyces cerevisiae ensembl False True Ensembl s3://bionty-assets/df_saccharomyces cerevisiae... 11775126b101233525a0a9e2dd64edae https://www.ensembl.org 1 None release-112 None 2025-02-24 09:30:12.017000+00:00 1 None 1
22 3EYyGRYN bionty.Protein human uniprot False True Uniprot s3://bionty-assets/df_human__uniprot__2024-03_... b5b9e7645065b4b3187114f07e3f402f https://www.uniprot.org 1 None 2024-03 None 2025-02-24 09:30:12.017000+00:00 1 None 1
25 01RWXN2V bionty.Protein mouse uniprot False True Uniprot s3://bionty-assets/df_mouse__uniprot__2024-03_... b1b6a196eb853088d36198d8e3749ec4 https://www.uniprot.org 1 None 2024-03 None 2025-02-24 09:30:12.017000+00:00 1 None 1
28 3kDh8qAX bionty.CellMarker human cellmarker False True CellMarker s3://bionty-assets/human_cellmarker_2.0_CellMa... d565d4a542a5c7e7a06255975358e4f4 http://bio-bigdata.hrbmu.edu.cn/CellMarker 1 None 2.0 None 2025-02-24 09:30:12.017000+00:00 1 None 1
29 7bV5uJo3 bionty.CellMarker mouse cellmarker False True CellMarker s3://bionty-assets/mouse_cellmarker_2.0_CellMa... 189586732c63be949e40dfa6a3636105 http://bio-bigdata.hrbmu.edu.cn/CellMarker 1 None 2.0 None 2025-02-24 09:30:12.017000+00:00 1 None 1
30 6LyRtvz8 bionty.CellLine all clo False True Cell Line Ontology https://data.bioontology.org/ontologies/CLO/su... ea58a1010b7e745702a8397a526b3a33 https://bioportal.bioontology.org/ontologies/CLO 1 None 2022-03-21 None 2025-02-24 09:30:12.017000+00:00 1 None 1
32 3Uw2Va7a bionty.CellType all cl False True Cell Ontology http://purl.obolibrary.org/obo/cl/releases/202... https://obophenotype.github.io/cell-ontology 1 None 2024-08-16 None 2025-02-24 09:30:12.017000+00:00 1 None 1
41 MUtAGdL4 bionty.Tissue all uberon False True Uberon multi-species anatomy ontology http://purl.obolibrary.org/obo/uberon/releases... http://obophenotype.github.io/uberon 1 None 2024-08-07 None 2025-02-24 09:30:12.017000+00:00 1 None 1
50 4a3ejKuf bionty.Disease all mondo False True Mondo Disease Ontology http://purl.obolibrary.org/obo/mondo/releases/... https://mondo.monarchinitiative.org 1 None 2024-08-06 None 2025-02-24 09:30:12.017000+00:00 1 None 1
59 4kswnHVF bionty.Disease human doid False True Human Disease Ontology http://purl.obolibrary.org/obo/doid/releases/2... bbefd72247d638edfcd31ec699947407 https://disease-ontology.org 1 None 2024-05-29 None 2025-02-24 09:30:12.024000+00:00 1 None 1
67 2a1HvjdB bionty.ExperimentalFactor all efo False True The Experimental Factor Ontology http://www.ebi.ac.uk/efo/releases/v3.70.0/efo.owl https://bioportal.bioontology.org/ontologies/EFO 1 None 3.70.0 None 2025-02-24 09:30:12.024000+00:00 1 None 1
74 48fBFLmn bionty.Phenotype human hp False True Human Phenotype Ontology https://github.com/obophenotype/human-phenotyp... e0f2e534eb2ad44a4d45573ef27b508f https://hpo.jax.org 1 None 2024-04-26 None 2025-02-24 09:30:12.024000+00:00 1 None 1
79 4t7QibxO bionty.Phenotype mammalian mp False True Mammalian Phenotype Ontology https://github.com/mgijax/mammalian-phenotype-... 795d8378fe48ec13b41d01a86dd1c86c https://github.com/mgijax/mammalian-phenotype-... 1 None 2024-06-18 None 2025-02-24 09:30:12.024000+00:00 1 None 1
82 sqPX2b7b bionty.Phenotype zebrafish zp False True Zebrafish Phenotype Ontology https://github.com/obophenotype/zebrafish-phen... 2231ebaa95becf8ff34a33c95a8d4350 https://github.com/obophenotype/zebrafish-phen... 1 None 2024-04-18 None 2025-02-24 09:30:12.024000+00:00 1 None 1
86 6S4qkDx1 bionty.Phenotype all pato False True Phenotype And Trait Ontology http://purl.obolibrary.org/obo/pato/releases/2... 6b1eaacd3d453b34375ce2e31c16328a https://github.com/pato-ontology/pato 1 None 2024-03-28 None 2025-02-24 09:30:12.024000+00:00 1 None 1
88 7Ent3V2y bionty.Pathway all go False True Gene Ontology https://data.bioontology.org/ontologies/GO/sub... 7fa7ade5e3e26eab3959a7e4bc89ad4f http://geneontology.org 1 None 2024-06-17 None 2025-02-24 09:30:12.024000+00:00 1 None 1
93 3rm9aOzL BFXPipeline all lamin False True Bioinformatics Pipeline s3://bionty-assets/df_all__lamin__1.0.0__BFXpi... https://lamin.ai 1 None 1.0.0 None 2025-02-24 09:30:12.024000+00:00 1 None 1
94 ugaIoIlj Drug all dron False True Drug Ontology https://data.bioontology.org/ontologies/DRON/s... https://bioportal.bioontology.org/ontologies/DRON 1 None 2024-08-05 None 2025-02-24 09:30:12.024000+00:00 1 None 1
98 1GbFkOdz bionty.DevelopmentalStage human hsapdv False True Human Developmental Stages https://github.com/obophenotype/developmental-... https://github.com/obophenotype/developmental-... 1 None 2024-05-28 None 2025-02-24 09:30:12.024000+00:00 1 None 1
100 10va5JSt bionty.DevelopmentalStage mouse mmusdv False True Mouse Developmental Stages https://github.com/obophenotype/developmental-... https://github.com/obophenotype/developmental-... 1 None 2024-05-28 None 2025-02-24 09:30:12.024000+00:00 1 None 1
102 MJRqduf9 bionty.Ethnicity human hancestro False True Human Ancestry Ontology https://github.com/EBISPOT/hancestro/raw/3.0/h... 76dd9efda9c2abd4bc32fc57c0b755dd https://github.com/EBISPOT/hancestro 1 None 3.0 None 2025-02-24 09:30:12.024000+00:00 1 None 1
103 5JnVODh4 BioSample all ncbi False True NCBI BioSample attributes s3://bionty-assets/df_all__ncbi__2023-09__BioS... 918db9bd1734b97c596c67d9654a4126 https://www.ncbi.nlm.nih.gov/biosample/docs/at... 1 None 2023-09 None 2025-02-24 09:30:12.024000+00:00 1 None 1