Description
Singer is an open-source standard for writing the scripts that move data from one place to another. The scripts that extract data are called taps, and the scripts that load data are called targets. Because they communicate through a standard stream of JSON messages, any tap can be combined with any target, so you can move data from a database, a web API, a file or a queue into any destination. The site says Singer is simple and composable: taps and targets are plain applications joined with pipes, with no daemon or complicated plugin system. Singer messages are JSON and can use JSON Schema for typed data and strict structure. State can be kept between runs, which supports incremental extraction, so a job only pulls new data. The site shows an example in which a tap pulls exchange rates from exchangeratesapi.io and a CSV target writes them to a file, installed with pip. A long directory of taps covers sources such as Amazon S3, Google Ads, Google Analytics, GitHub, GitLab, Facebook Ads, Chargebee and many others, and a matching set of targets covers destinations. The project has a getting started guide on GitHub and a community Slack, and a roadmap.…
Highlights
- Taps extract and targets load over JSON
- Any tap can feed any target
- Incremental extraction with saved state
- Directory of many taps and targets
Ratings & Reviews
No ratings yet
Be the first to rate Singer.
People also visit
Hevo Automated Data Pipeline
Replicate, transform, and monitor data pipelines effortlessly
Singer FAQ
What is Singer?
An open-source standard for writing taps, which extract data, and targets, which load it, that communicate over JSON.
How do I try it?
The site's example installs a tap and a target with pip, then pipes the tap into the target to write a CSV file.
Can I combine any tap with any target?
Yes. The site says taps and targets can be used in any combination, because they share the same JSON format.
Does it support incremental runs?
Yes. Singer can keep state between invocations, so a job pulls only new data.
Where can I find sources?
The site has a directory of taps and targets, with sources such as Amazon S3, Google Ads, GitHub and Facebook Ads.
Is it open source?
Yes. The site describes it as open-source ETL, and the code is on GitHub at singer-io.
What are the best Singer alternatives?
Popular alternatives to Singer include Meltano, Airbyte and Keboola. See all Singer alternatives







