#

hdfs

Here are 934 public repositories matching this topic...

seaweedfs

seaweedfs / seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

kubernetes distributed-systems fuse replication cloud-drive s3 posix s3-storage hdfs distributed-storage distributed-file-system erasure-coding object-storage blob-storage seaweedfs hadoop-hdfs tiered-file-system

Updated Aug 2, 2024
Go

heibaiying / BigData-Notes

Đại số liệu nhập môn chỉ nam ⭐

phoenix scala kafka big-data spark yarn hive hadoop storm bigdata hbase zookeeper hdfs mapreduce flume azkaban sqoop

Updated Jan 5, 2024
Java

ceph

ceph / ceph

Ceph is a distributed object, block, and file storage platform

Updated Aug 3, 2024
C++

juicefs

juicedata / juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

go redis golang distributed-systems storage filesystem bigdata s3 posix hdfs cloud-native object-storage

Updated Aug 2, 2024
Go

wangzhiwubigdata / God-Of-BigData

Chuyên chú đại số liệu học tập phỏng vấn, đại số liệu thành thần chi lộ mở ra. Flink/Spark/Hadoop/Hbase/Hive...

kafka spark hive hadoop bigdata hbase zookeeper hdfs flume flink azkaban

Updated Aug 7, 2023

piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

Python streaming s3 file hdfs hacktoberfest webhdfs boto gzip-stream bz2 streaming-data

Updated Jul 25, 2024
Python

TileDB-Inc / TileDB

The Universal Storage Engine

data-science storage-engine s3 sparse-data scientific-computing s3-storage arrays hdfs data-analysis dataframes tiledb dense-data sparse-arrays

Updated Aug 2, 2024
C++

water8394 / BigData-Interview

🎯 🌟[ đại số liệu phỏng vấn đề ] chia sẻ chính mình ở trên mạng bắt được đại số liệu tương quan phỏng vấn đề cùng với chính mình đáp án tổng kết. Trước mắt bao hàm Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper dàn giáo phỏng vấn đề tri thức tổng kết

kafka spark yarn hadoop bigdata interview hbase hdfs mapreduce interview-questions flink

Updated Aug 30, 2021

collabH / bigdata-growth

Đại số liệu tri thức kho hàng đề cập đến số liệu kho hàng kiến mô, thật khi tính toán, đại số liệu, số liệu trung đài, hệ thống thiết kế, Java, thuật toán chờ.

kafka spark hive hadoop bigdata kudu hbase olap hdfs mapreduce flink debezium bigdatalearning hudi

Updated Aug 1, 2024
Shell

colinmarc / hdfs

A native go client for HDFS

go commandline hdfs

Updated May 20, 2024
Go

Addax

wgzhao / Addax

Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.

mysql database influxdb hive hadoop etl clickhouse excel kudu impala postgresql oracle hdfs sqlserver data-integrity datax trino

Updated Aug 1, 2024
Java

spotify / snakebite

A pure Python HDFS client

Python hdfs Python -hdfs-client

Updated Apr 19, 2022
Python

HariSekhon / DevOps-Python-tools

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Python linux docker aws elasticsearch devops json cloudformation spark hadoop avro travis-ci solr gcp hbase pyspark hdfs parquet dockerhub gcf

Updated Jul 2, 2024
Python

sunnyandgood / BigData

💎🔥 đại số liệu học tập bút ký

mysql linux shell hive hadoop hbase zookeeper hdfs mapreduce flume sqoop

Updated May 13, 2019
Java

Stratio / sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

workflow lambda streaming real-time scala kafka spark analytics spark-streaming olap hdfs sparksql triggers streaming-data stratio sparta stratio-sparta

Updated Oct 24, 2019
Scala

lensesio / kafka-connect-ui

Web tool for Kafka Connect |

redis mqtt elasticsearch twitter kafka cassandra influxdb jms s3 documentdb hdfs kafka-connect

Updated Dec 16, 2023
JavaScript

dromara / CloudEon

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.

kubernetes yarn hadoop bigdata hdfs cloudnative doris

Updated Jul 24, 2024
FreeMarker

fabiogjardim / bigdata_docker

Big Data Ecosystem Docker

mysql mongo spark presto hive hadoop jupyter-notebook hbase zookeeper metabase hdfs hue nifi

Updated Apr 29, 2023
VBA

uber / storagetapper

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

mysql json kafka avro etl clickhouse postgresql s3 msgpack hdfs cdc

Updated Mar 19, 2023
Go

Spark-with-Python

tirthajyoti / Spark-with-Python

Fundamentals of Spark with Python (using PySpark), code examples

Python machine-learning sql database big-data spark apache-spark hadoop analytics parallel-computing distributed-computing apache map-reduce pyspark hdfs dataframe mlib

Updated Oct 29, 2022
Jupyter Notebook

Improve this page

Add a description, image, and links to the hdfs topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the hdfs topic, visit your repo's landing page and select "manage topics."