Stitch Data Blog

- https://hevodata.com/ - https://airbyte.com/ - https://www.stitchdata.com/ Unfortunately none of them are perfect as your data scales, each have up and downsides...

We've previously used Stitch data https://www.stitchdata.com/ and found it super easy to stream cdc to redshift and snowflake Will give artie a go

https://www.stitchdata.com/ A happy user. It helps you connect data from multiple places and write to a single source. Anyone know a smiliar open source project like that?

I'm currently using Stitch (https://www.stitchdata.com/) to move data from a few sources to Redshift. Since Stitch, Meltano and Pipelinewise all use Singer.io taps and targets under the hood, I wonder if there's any reason to choose one over the other?

Stitch | Philadelphia, PA | https://www.stitchdata.com/jobs/ Stitch is an ETL service built for developers. Stitch connects to today’s most popular business tools – Salesforce, Facebook Ads, and many more – and replicates the raw data to a data warehouse. With Stitch, decision-makers are free to interact with their company’s data using the tools of their choice, whether that’s BI platforms like Mode and Looker, data science languages like R and Python, or a simple SQL client. We are hiring for the following roles, which are all full-time and onsite in Philadelphia: - Lead QA Engineer - Product Manager - Sales Development Representative (x2) Send your resume to [email protected] or apply at the link above!

We use Stitch[1] for this. You can selectively replicate some tables from any "source" to any selected destination[2]. I believe 1 destination is there on the free plan. You can point to any self hosted(or cloud) Postgres DBs. There are a bunch of supported destinations eg. Postgres, Snowflake etc. The sources also can be a varied like Google sheets. We use this to send relevant tables to analytics teams outside of engineering. There's a bit of tweaking initially(i.e. having a timestamp column like 'last_updated` helps to replicate only those rows) Having a separate readonly DB user is also pretty common. We use that internally inside engineering(where we trust them slightly more). Important bit is to always add a statement_timeout so people cannot not run random slow queries on your production database that are hung for days. I've also had my eye on https://www.singer.io/ , which seems like an open source ETL tool similar to Stitch. But i've not experimented with it locally yet. It uses "taps" and "targets" nomenclature. And there's a healthy ecosystem of opensource extensions of creating your own taps/targets. [1] https://www.stitchdata.com/ [2] https://www.stitchdata.com/integrations/destinations/

While this is a very open question both in terms of your analytical resources (dedicated data engineers, how tech savy are analysts, can they easily model their own data) as well as constraints from operating in an enterprise setup with regards to DevOps (easy to open ports, can data viz solutions be run online or only on prem), I'll try to mention a bunch of tools assuming they can be used. Notably, one thing you did not mention is which data visualization tool is used and how much that allows general business users to get insights. Database: In terms of enterprise ready Data Warehousing databases I would take a good look at Exasol (on prem & cloud) and Snowflake (cloud only). Exasol will likely be the pricier of the two and is much closer to the Java based Oracle world than Snowflake. Personally, I'm not a big fan of Redshift, as Snowflake takes all the pain that one might experience in Redshift away (manual tuning of sort & dist keys, tuning of coupled storage & compute clusters). Again, if you have good data engineering resources readily available it might make sense to look into a comparative cost analysis of the three in more detail. Notably, Snowflake has Snowpipe, a native API allowing you to stream data into the DB. Data modeling: You mentioned you use Kimball. In my experience while this is the definite choice for analytical querying and modeling, in an enterprise setup it might make sense to draw a Data Vault model layer between your raw sources and your…

You might wanna check out Rudderstack or Stitchdata: https://rudderstack.com/guides/how-to-load-data-from-google-sheets-to-… https://www.stitchdata.com/blog/google-sheets-stitch-easy-sync-to-reds… And here's a reverse path from Census as well: https://www.getcensus.com/sync/redshift-to-google-sheets

Do you plan to support one-click integrations? (= Stitch Connect JS [0] / Fivetran "Connect Card" [1]) [0] https://www.stitchdata.com/docs/developers/stitch-connect/javascript-c… [1] https://fivetran.com/docs/rest-api/connectors/connect-card

Pure SaaS. Check their pricing [1], as is row based and depending on how much data you need to move it can easily go out of budget ;) [1] https://www.stitchdata.com/pricing/

https://github.com/harvard-dce/zoom-recording-ingester https://www.stitchdata.com/integrations/zoom/amazon-s3/

I think yes, all these products -> https://segment.com, https://rudderstack.com, https://snowplowanalytics.com, https://fivetran.com, https://stitchdata.com, https://www.alooma.com, https://singer.io, https://www.holistics.io, can work as a pipeline, but some have more features than others. This is a bit simplifying answer.

Typically these platforms will query on a data warehouse that you provide: redshift, bigquery, a big postgres instance, or the like. In terms of getting data into that warehouse, you can write ETL (extract, transform, load) scripts yourself. There are also a number of ETL-as-a-service providers like Stitch or Fivetran that cover common things you might want to sync into your data warehouse and query like salesforce, google analytics, quickbooks, etc: https://www.stitchdata.com/integrations/sources/

We (Stitch) have DB2 in production today https://www.stitchdata.com/integrations/db2/

Hey Hacker News! Jenna here, product manager for Stitch Connect. Let me know if I can answer any questions about Connect or Stitch in general, or take a look at our website for more info: https://www.stitchdata.com/connect/

some of the many links in that article https://apnews.com/article/google-chrome-privacy-lawsuit-settlement-20… https://apnews.com/article/private-incognito-browsing-explainer-google… https://carnegieendowment.org/2023/09/07/facebook-telegram-and-ongoing… https://epic.org/issues/consumer-privacy/data-brokers/ https://lithub.com/surveillance-capitalism-and-the-internet-of-things/ https://mitsloan.mit.edu/ideas-made-to-matter/machine-learning-explain… https://news.harvard.edu/gazette/story/2019/03/harvard-professor-says-… https://proton.me/blog/privacy-washing-2023 https://theconversation.com/explainer-what-is-surveillance-capitalism-… https://www.abc.net.au/news/2018-06-25/healthengine-sharing-patients-i… https://www.apa.org/monitor/2024/04/addressing-equity-ethics-artificia… https://www.axios.com/2017/12/15/sean-parker-unloads-on-facebook-god-o… https://www.brennancenter.org/our-work/research-reports/closing-data-b… https://www.buzzfeednews.com/article/meghara/period-tracker-apps-faceb… https://www.commonsense.org/education/articles/a-majority-of-apps-are-…