반응형
/*
-- Title : 데이터 엔지니어링 스택 - ver.dBRang
-- Tag : 데이터 스택 데이터스택 데이터 스텍 데이터스텍, data engineering stack
*/
| Category | Section | Stack |
| Data Processing | Batch | • Apache Pig |
| • Apache Arrow | ||
| • Amazon Glue | ||
| • Google Cloud Data Fusion | ||
| Hybrid | • Apache Spark | |
| • Apache Beam | ||
| • Apache Flink | ||
| • Apache Nifi | ||
| • dataform | ||
| Streaming | • Apache Kafka | |
| • Apache Storm | ||
| •Apache Samza | ||
| • Amazon Kinesis | ||
| • CONFLUENT | ||
| Message Queue | • Apache RabbitMQ | |
| • Amazon SS & SOS | ||
| • Google Cloud Pub/Sub | ||
| • Azure Sercive Bus | ||
| Workflow Scheduling | • Apache Airflow | |
| • Apache Oozoe | ||
| • Google Composer | ||
| • Luigi |
| Cetegory | Section | Stack |
| Relational DB |
SQL | • PostgreSQL |
| • Maria DB | ||
| • MySQL | ||
| • Oracle | ||
| • SQL Server | ||
| • Amazon Aurora | ||
| NewSQL | • Apache Ignite | |
| • VoltDB | ||
| • ClustrixDB | ||
| • MemSQL | ||
| • NuoDB | ||
| Non-Relational DB (NoSQL) |
Document DB | • MongoDB |
| • Elastic Search | ||
| • Couchbase | ||
| • Apache Couch DB | ||
| • Azure Cosmos DB | ||
| Column Store DB (Wide Column DB) |
• Apache Cassandra | |
| • Apache Hbase | ||
| • Google Cloud Bigtable | ||
| • Azure Table Storage | ||
| Graph DB | • Neo4j | |
| • AgensGraph | ||
| • Amazon Neptune | ||
| Key-Value Store | • Redis | |
| • Memcached | ||
| • Amazon DynamoDB |
| Cetegory | Section | Stack |
| DW/BI | • Apache Impala | |
| • Amazon Redshift | ||
| • Google BigQuery | ||
| • Azure Synapse Analytics | ||
| • Snowflake | ||
| • Databricks | ||
| • Clickhouse | ||
| • Presto | ||
| Data Lake | • Apache Ozone | |
| • AWS S3 | ||
| • Google Cloud Storage | ||
| • Azure Blob Storage | ||
| • Azure Data Lake Storage | ||
| • DELTA LAKE |
| Cetegory | Section | Stack |
| Business Intelligence | • Google Data Studio | |
| • Tableau | ||
| • Qlik | ||
| • Power BI | ||
| Intelligence | • Apache Spark ML | |
| • Amazon Machine Learning | ||
| • Amazon SageMaker | ||
| • Azure Machinen Learning |
| Cetegory | Section | Stack |
| Monitoring | • Prometheus | |
| • Datadog | ||
| • Sentry | ||
| • Monte Carlo | ||
| • Datafold | ||
| • Soda Data | ||
| • StatsD |
※ 참고자료
• github.com/datastacktv
• namrmino.tistory.com
반응형