Getting Started
Sharing and exploring focal amplification data on AmpliconRepository.org is designed to be straightforward.
TL;DR for Cohort Users: If you have run AmpliconSuite-pipeline on a cohort of samples, simply package the resulting output directory into a .tar.gz or .zip file and upload it. The backend will automatically handle the discovery and aggregation of all samples in your cohort.
1. Generate focal amplification predictions
Data on AmpliconRepository typically comes from the AmpliconSuite ecosystem. The recommended workflow is to use AmpliconSuite-pipeline, which integrates: * Data Preparation (CNV calling via CNVkit or other tools) * AmpliconArchitect (AA) (Focal amplification reconstruction) * AmpliconClassifier (AC) (Classification of amplicon types like ecDNA or BFB)
Once your pipeline runs are complete, you will have directories containing _AA_results, _classification, and _cnvkit_output.
2. Package your results
To upload data, you must package your results into one or more .tar.gz or .zip archives. When you upload these files, the AmpliconRepository backend automatically discovers and aggregates your data.
The backend is designed to be flexible: it walks your directory tree and identifies samples based on folder suffixes and the contents of your classification tables.
Key Components
For the backend to correctly link your data, ensure the following components are present in your archive:
- Authoritative Sample List: The backend uses
*_result_table.tsvfiles (produced by AmpliconClassifier) as the source of truth. It will include every sample listed in these tables that it can find matching data for. - AA Results: Directories ending in
_AA_resultscontaining the reconstructions. - Classification Data: Directories or files containing the AmpliconClassifier classification outputs.
- CNV Calls: Directories ending in
_cnvkit_output(or_cnvkit_outputs) containing the.bedfiles, or generally speaking any directory(s) containing the whole genome CNV call files named like [sample_name]_CNV_CALLS.bed
Flexible Organizational Styles
You can organize your files in the way that best fits your workflow:
- Per-Sample Organization: Each sample has its own set of directories (e.g.,
sample1_AA_results/,sample1_classification/, etc.). - Project-Wide Organization: You can have a single, consolidated classification directory for the entire project, while keeping AA and CNVkit results in separate folders.
- Nested Folders: The backend will recursively search through your archive, so you can group samples into subfolders (e.g., by cohort or batch).
Example Structure (Mixed Style)
The following is just one example of a valid hierarchy:
my_study/
├── cohort_A/
│ ├── sample1_AA_results/
│ ├── sample1_cnvkit_output/
│ ├── sample2_AA_results/
│ └── sample2_cnvkit_output/
└── project_classification/ <-- Consolidated classifications
├── sample1_result_table.tsv
├── sample2_result_table.tsv
└── ...
How to create your archive
Package your results from the command line. Important: Do not include original .bam, .fastq, or .cram files.
# Packaging command (run from outside your data directory)
tar --exclude='*.gz' --exclude='*.bam*' --exclude='*.cram*' -czf my_project.tar.gz my_study/
3. Create or Update a Project
Once your archives are ready, head to AmpliconRepository.org.
Creating a New Project
- Log in and select "New Project" from your account menu.
- Project Name & Alias: Choose a descriptive name. You can also set a Project Alias (e.g.,
my-study-2024) to create a clean, shareable URL:ampliconrepository.org/project/my-study-2024/. - Upload Archives: You can select multiple
.tar.gzfiles at once. The server will aggregate them into a single project automatically. - Submit: After clicking submit, you will be redirected to the project page.
Note: Large projects are processed in the background. You can leave the page or close your browser; the project will update automatically once processing is complete.
Updating or Adding Samples to a Project
You can update your project or add new data at any time by selecting "Edit Project" from the project page.
When adding data, you can choose from three modes:
* Append Samples (Add Data): Use this to add new .tar.gz files to your existing project. The new samples will be aggregated alongside your current data. This is the standard way to grow a project as more samples are processed.
* Replace Project: Use this to wipe all current samples and replace them entirely with the newly uploaded files.
* Re-aggregate: Re-process the existing data on the server. This is useful if you want to apply new metadata (like sample renaming) to data that is already uploaded without re-uploading the archives.
Steps to add samples:
1. Navigate to your project page and click the Edit (pencil icon) button.
2. Under the "Upload" section, select your new .tar.gz or .zip archives.
3. Ensure the "Append Samples" mode is selected (this is usually the default).
4. Click Submit. The backend will process the new samples and add them to the project view once complete.
4. Add Metadata & Rename Samples
You can upload a metadata file (CSV, TSV, or XLSX) to annotate your samples.
Metadata Requirements:
* First Column: Must be sample_name (must match the names in your uploaded data).
* Second Column: Must be cancer_type.
* Additional Columns: Any other annotations (Tissue, Stage, Treatment, etc.).
Deep Renaming with Aliases
If your metadata includes a column named sample_name_alias, the repository can perform a "Deep Rename." This physically renames the samples in the database and across all internal files (tables, logs, etc.) to match your aliases, making the project much easier for others to navigate.
Need help?
If you encounter issues during upload or have questions about data formatting, please reach out on our GitHub issues page. We are happy to help!