{"data":{"featured":{"edges":[{"node":{"frontmatter":{"title":"Reddit Worldnews Pipeline","cover":{"childImageSharp":{"gatsbyImageData":{"layout":"constrained","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAOCAIAAACgpqunAAAACXBIWXMAAB7CAAAewgFu0HU+AAABUUlEQVQoz42SiU4CMRBA+f9fMn4DKmgU8IDN7pYFtnv1nsO0RCK4BCfNpG3mzT3hMSGKumtBFO70/CuTMybp1nJt4kXrIEp1A0ZEACBmTEZfNUzzAIjHH6CoAzKNwlmWrRZvneeiCSk8ycE9rPZ75ZznXA5Vb4BG4kfYWqu1BkClLTMDRrP5pnwsqlZxJXUljRw8/6Q2UjMlz/PZbLfbEXOvwn71Xmzl83LjnDPO0bWGESV2ep8tXpQ2tQ2vVdcM/lAfOuVj8Ui1p8Ji6tFYt4dsBS5mLgcrpCJC70Ovba+NVcO88XfCMNG2GADwEj4lf9C8fFq0ea6NW4tta+K0IYSQXDtnj2bnMOGRB+ZWiMP6U1ZCp2IBL7s1EvkE96WoNutGNh/Sds4T/xPmuBKO4iFm0fSttnhtzqNli+2+kmWabfxAurXbvwW9JwinhR/d7W8akzT9jqcFzgAAAABJRU5ErkJggg=="},"images":{"fallback":{"src":"/static/61a566a2eb21f208a093263fced9d038/89684/reddit.png","srcSet":"/static/61a566a2eb21f208a093263fced9d038/dc90d/reddit.png 175w,\n/static/61a566a2eb21f208a093263fced9d038/c2b9a/reddit.png 350w,\n/static/61a566a2eb21f208a093263fced9d038/89684/reddit.png 700w,\n/static/61a566a2eb21f208a093263fced9d038/29225/reddit.png 1400w","sizes":"(min-width: 700px) 700px, 100vw"},"sources":[{"srcSet":"/static/61a566a2eb21f208a093263fced9d038/bf026/reddit.avif 175w,\n/static/61a566a2eb21f208a093263fced9d038/53a94/reddit.avif 350w,\n/static/61a566a2eb21f208a093263fced9d038/3f7ae/reddit.avif 700w,\n/static/61a566a2eb21f208a093263fced9d038/46f2c/reddit.avif 1400w","type":"image/avif","sizes":"(min-width: 700px) 700px, 100vw"},{"srcSet":"/static/61a566a2eb21f208a093263fced9d038/48048/reddit.webp 175w,\n/static/61a566a2eb21f208a093263fced9d038/d8098/reddit.webp 350w,\n/static/61a566a2eb21f208a093263fced9d038/c73ff/reddit.webp 700w,\n/static/61a566a2eb21f208a093263fced9d038/15b27/reddit.webp 1400w","type":"image/webp","sizes":"(min-width: 700px) 700px, 100vw"}]},"width":700,"height":500.00000000000006}}},"tech":["Python","Airflow","Terraform","Ansible","Docker","Prometheus","Grafana","Loki","Soda Core","Snowflake","GitHub Actions","Traefik"],"github":"https://github.com/Bee0933/reddit-r-news-pipeline","external":"#","cta":"https://github.com/Bee0933/reddit-r-news-pipeline"},"html":"

Production-grade data pipeline extracting Reddit Worldnews data, deployed on DigitalOcean using Airflow.

\n

Infrastructure is managed with Terraform and Ansible, with containerized services via Docker. Data is stored and analyzed in Snowflake, while monitoring and observability are powered by Prometheus, Grafana, and Loki. CI/CD is automated with GitHub Actions, and data quality is enforced using Soda Core.

"}},{"node":{"frontmatter":{"title":"Data Ingestion Platform","cover":{"childImageSharp":{"gatsbyImageData":{"layout":"constrained","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAPCAIAAABr+ngCAAAACXBIWXMAAB7CAAAewgFu0HU+AAAB70lEQVQoz4VSCW4bMQzc//8g/Uf6ABfoAbRAC8RxnNaOY228lvfQsaJuUcVecQIU6EASBJFDjkgWeQYOG6fLuDDl/6HIOceEXw7G+Nm705Yw9YMEE3AMdwUu5/ReTK/3lXtuzOrXvjq1zW5/kfqJZ0aaLamphIWGC33JjIjeuY6rI+nWu5IQyk/UOu98oJSfO7AhzoogPFCfc+batkrPZMxZib5+2HSsYxJ0HOKLkrTkKBSkJRmEvDkZeVifWkVaSGmUjYjOB7COcw6q994j5p6L+tIIqd7qBG1fqpoxrkTnJzLXYbWzPmbj47qk2hjE/PUYL6zvQXOlY5yVS6kv3z7RS1dWtfVxypyZyd9/2nPtqQAFkFJkCu+328cD2Z47THHS3kn9fDy3XEuTfEjFVHUtxH5HaSONR2NMTEk+3rWNqFtmXcg5p5iMtRI839z1ykmDIeJMZk9/+LnqhAQ7d9uFxKTmvUmYrXNVXSGi0v50JBKcdsN0zH1OQzGMsfqfkxS8U5JPdx+uo1O8esSYWOdnw3i8lGVT11M7Jh8Tso/vx3Mmh/x5JawdjCkN4j/c3Hy8vR0/HCc67fF3HV/ntFjSRq1130sACCHEGJVSbdsyxgAgjrDWAoCQvbXWOXcl43tM4RAxjZjrktJouvr8BUTxZB831U1QAAAAAElFTkSuQmCC"},"images":{"fallback":{"src":"/static/5af9c03c5b0ef23ff90fb48a83a319cd/ddfa4/data-platform.png","srcSet":"/static/5af9c03c5b0ef23ff90fb48a83a319cd/4725b/data-platform.png 175w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/52329/data-platform.png 350w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/ddfa4/data-platform.png 700w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/a69cb/data-platform.png 1400w","sizes":"(min-width: 700px) 700px, 100vw"},"sources":[{"srcSet":"/static/5af9c03c5b0ef23ff90fb48a83a319cd/51f62/data-platform.avif 175w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/bb6a7/data-platform.avif 350w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/b7f4a/data-platform.avif 700w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/01d1e/data-platform.avif 1400w","type":"image/avif","sizes":"(min-width: 700px) 700px, 100vw"},{"srcSet":"/static/5af9c03c5b0ef23ff90fb48a83a319cd/a487a/data-platform.webp 175w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/ce7ff/data-platform.webp 350w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/8fc5a/data-platform.webp 700w,\n/static/5af9c03c5b0ef23ff90fb48a83a319cd/a7746/data-platform.webp 1400w","type":"image/webp","sizes":"(min-width: 700px) 700px, 100vw"}]},"width":700,"height":508}}},"tech":["DigitalOcean","Python","Docker","GitHub Actions","Airbyte","Minio","DuckDB","PostgreSQL","Terraform","Ansible","Prometheus","Loki","Node Exporter","Promtail"],"github":"https://github.com/Bee0933/Data-ingestion-platform","external":"#","cta":"https://github.com/Bee0933/Data-ingestion-platform"},"html":"

Built an automated data ingestion pipeline using DigitalOcean, Python, Docker, GitHub Actions, and other tools. Airbyte orchestrates data ingestion from a secure SFTP server, storing it in Minio.

\n

DuckDB enables efficient querying and analysis. Infrastructure is managed with Terraform, and configuration is automated with Ansible. Docker ensures portability, while Prometheus, Loki, Node Exporter, and Promtail handle monitoring for performance and system health. The platform supports scalable, real-time analytics.

"}},{"node":{"frontmatter":{"title":"Filecoin Nodes Infrastructure","cover":{"childImageSharp":{"gatsbyImageData":{"layout":"constrained","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAICAIAAAB2/0i6AAAACXBIWXMAAB7CAAAewgFu0HU+AAABGklEQVQY03WQW0vDUBCE8///mvpYKmKr9mLSJG3O5lz3eiRtQUX8mIeFZZidbZi51mp3lENPlE1IGYUycS4wCWYzFkZhVCFjMmEza+Z5btvWFXOOvVPhMLw/9lOXCuTs3O7Jdds8D6PrEwbmJEp1SdNaa0NEiMhqsw/OgQlO8+Hjc3NutylDjJeUJ+jW/aWdjutxfGWlqlKLr9UaEalXQgiTc0oR2ufL1Hs4kaToTrB/8QWQvHPHVbsq0PG4w7cHE76brd5hDKd+t2v359O2kA8wwGGDmmKBwqEUYEGzenN9J1//pcJFNCcYIgzMGYuPbogRED1TIo6qvBTW3+Y7pqZiyymLVCWXfFsssh+qtWFm+4NeuQ0iYv/wBW++0Ash+3F3AAAAAElFTkSuQmCC"},"images":{"fallback":{"src":"/static/e9a61b115337fe7185a63eab02d8fc86/124cd/filecoin.png","srcSet":"/static/e9a61b115337fe7185a63eab02d8fc86/49fdc/filecoin.png 175w,\n/static/e9a61b115337fe7185a63eab02d8fc86/20f96/filecoin.png 350w,\n/static/e9a61b115337fe7185a63eab02d8fc86/124cd/filecoin.png 700w,\n/static/e9a61b115337fe7185a63eab02d8fc86/4c490/filecoin.png 1400w","sizes":"(min-width: 700px) 700px, 100vw"},"sources":[{"srcSet":"/static/e9a61b115337fe7185a63eab02d8fc86/6916e/filecoin.avif 175w,\n/static/e9a61b115337fe7185a63eab02d8fc86/bf034/filecoin.avif 350w,\n/static/e9a61b115337fe7185a63eab02d8fc86/dfaa3/filecoin.avif 700w,\n/static/e9a61b115337fe7185a63eab02d8fc86/86575/filecoin.avif 1400w","type":"image/avif","sizes":"(min-width: 700px) 700px, 100vw"},{"srcSet":"/static/e9a61b115337fe7185a63eab02d8fc86/f6b1d/filecoin.webp 175w,\n/static/e9a61b115337fe7185a63eab02d8fc86/0b535/filecoin.webp 350w,\n/static/e9a61b115337fe7185a63eab02d8fc86/94d15/filecoin.webp 700w,\n/static/e9a61b115337fe7185a63eab02d8fc86/e4c85/filecoin.webp 1400w","type":"image/webp","sizes":"(min-width: 700px) 700px, 100vw"}]},"width":700,"height":297}}},"tech":["Terraform","AWS (S3, EC2)","Ansible","Docker","Prometheus","Grafana","Github Actions","Nginx","Slack"],"github":"https://github.com/Bee0933/filecoin-nodes","external":"#","cta":"https://github.com/Bee0933/filecoin-nodes"},"html":"

End-to-end infrastructure for deploying Filecoin Forest and Lotus nodes on AWS. Configurations optimize storage, availability, monitoring, and security. Automates deployment using Terraform, Ansible, and Docker, with monitoring through Prometheus, Grafana, and Slack alerts.

"}},{"node":{"frontmatter":{"title":"Inside Airbnb Pipeline","cover":{"childImageSharp":{"gatsbyImageData":{"layout":"constrained","placeholder":{"fallback":"data:image/jpeg;base64,/9j/2wBDABALDA4MChAODQ4SERATGCgaGBYWGDEjJR0oOjM9PDkzODdASFxOQERXRTc4UG1RV19iZ2hnPk1xeXBkeFxlZ2P/2wBDARESEhgVGC8aGi9jQjhCY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2NjY2P/wgARCAAMABQDASIAAhEBAxEB/8QAFgABAQEAAAAAAAAAAAAAAAAAAAEF/8QAFAEBAAAAAAAAAAAAAAAAAAAAAP/aAAwDAQACEAMQAAAB3LRQf//EABUQAQEAAAAAAAAAAAAAAAAAAAEg/9oACAEBAAEFAlr/xAAUEQEAAAAAAAAAAAAAAAAAAAAQ/9oACAEDAQE/AT//xAAUEQEAAAAAAAAAAAAAAAAAAAAQ/9oACAECAQE/AT//xAAUEAEAAAAAAAAAAAAAAAAAAAAg/9oACAEBAAY/Al//xAAYEAADAQEAAAAAAAAAAAAAAAABESEAIP/aAAgBAQABPyEgcxNS5//aAAwDAQACAAMAAAAQ8w//xAAUEQEAAAAAAAAAAAAAAAAAAAAQ/9oACAEDAQE/ED//xAAUEQEAAAAAAAAAAAAAAAAAAAAQ/9oACAECAQE/ED//xAAcEAACAwADAQAAAAAAAAAAAAAAAREhMUFRYXH/2gAIAQEAAT8QomIa9ORN07pC+GNvs2GSf//Z"},"images":{"fallback":{"src":"/static/79c05810a30a5ab69a409c724fd5733c/40e3d/airbnb-pipeline.jpg","srcSet":"/static/79c05810a30a5ab69a409c724fd5733c/63d33/airbnb-pipeline.jpg 175w,\n/static/79c05810a30a5ab69a409c724fd5733c/343f0/airbnb-pipeline.jpg 350w,\n/static/79c05810a30a5ab69a409c724fd5733c/40e3d/airbnb-pipeline.jpg 700w,\n/static/79c05810a30a5ab69a409c724fd5733c/10e6d/airbnb-pipeline.jpg 1400w","sizes":"(min-width: 700px) 700px, 100vw"},"sources":[{"srcSet":"/static/79c05810a30a5ab69a409c724fd5733c/becf4/airbnb-pipeline.avif 175w,\n/static/79c05810a30a5ab69a409c724fd5733c/b3869/airbnb-pipeline.avif 350w,\n/static/79c05810a30a5ab69a409c724fd5733c/0af04/airbnb-pipeline.avif 700w,\n/static/79c05810a30a5ab69a409c724fd5733c/8ad3e/airbnb-pipeline.avif 1400w","type":"image/avif","sizes":"(min-width: 700px) 700px, 100vw"},{"srcSet":"/static/79c05810a30a5ab69a409c724fd5733c/d905c/airbnb-pipeline.webp 175w,\n/static/79c05810a30a5ab69a409c724fd5733c/cb91b/airbnb-pipeline.webp 350w,\n/static/79c05810a30a5ab69a409c724fd5733c/9391b/airbnb-pipeline.webp 700w,\n/static/79c05810a30a5ab69a409c724fd5733c/bb101/airbnb-pipeline.webp 1400w","type":"image/webp","sizes":"(min-width: 700px) 700px, 100vw"}]},"width":700,"height":407}}},"tech":["Python","SQL","Terraform","DBT","AWS (ECS Fargate, S3, Redshift)","Prefect","Slack"],"github":"https://github.com/Bee0933/inside-airbnb-pipeline?tab=readme-ov-file#inside-airbnb-pipeline","external":"#","cta":"https://github.com/Bee0933/inside-airbnb-pipeline?tab=readme-ov-file#inside-airbnb-pipeline"},"html":"

End-to-end data pipeline for Airbnb Sydney data, automating ingestion, cleaning, and transformation using Python, SQL, and dbt.
\nGenerates analytics tables revealing trends in pricing, availability, and host behavior.

"}},{"node":{"frontmatter":{"title":"Domain Checker","cover":{"childImageSharp":{"gatsbyImageData":{"layout":"constrained","placeholder":{"fallback":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAJCAIAAAC9o5sfAAAACXBIWXMAAAsTAAALEwEAmpwYAAABCUlEQVQoz52QvUsDQRDF8w/a2gq2tjbiB4ooghgsxDTaWViITSyCBAkYgoJRoqCQwBUHQbyEu9Pbu73dm50nu0KQGKL4imFg+M28eaVoMKToHf9SKc8yIxUABsgYAggwbPU7POoM0dNd++ay/tJ+8Lpdu87xuueJRhNa8xSYiR4vavW9g1bl+Pr0LJUSDAXE1Zo4PNLWk7M3AXZHgvvO82a5s7rjN5oFAKK5xaXzmVnsV/wwDILByM6Py0CeJDKM1EeiskwppYGTrd3+/IJY215e2bhq3drvjJkEMxvmXGuRpgRIv/+6Xi7ehnakVBzH9A0bh794crLJSyl6XpGrP6U9JsOsXZ0CfwIvgf/HRtVEgwAAAABJRU5ErkJggg=="},"images":{"fallback":{"src":"/static/bb1ee92ad2d229a0c90136a2a70c3294/0a3b9/dga.png","srcSet":"/static/bb1ee92ad2d229a0c90136a2a70c3294/b13f7/dga.png 175w,\n/static/bb1ee92ad2d229a0c90136a2a70c3294/87320/dga.png 350w,\n/static/bb1ee92ad2d229a0c90136a2a70c3294/0a3b9/dga.png 700w","sizes":"(min-width: 700px) 700px, 100vw"},"sources":[{"srcSet":"/static/bb1ee92ad2d229a0c90136a2a70c3294/9d1e9/dga.avif 175w,\n/static/bb1ee92ad2d229a0c90136a2a70c3294/00b33/dga.avif 350w,\n/static/bb1ee92ad2d229a0c90136a2a70c3294/1cd0a/dga.avif 700w","type":"image/avif","sizes":"(min-width: 700px) 700px, 100vw"},{"srcSet":"/static/bb1ee92ad2d229a0c90136a2a70c3294/d75a4/dga.webp 175w,\n/static/bb1ee92ad2d229a0c90136a2a70c3294/5c7a0/dga.webp 350w,\n/static/bb1ee92ad2d229a0c90136a2a70c3294/62a7e/dga.webp 700w","type":"image/webp","sizes":"(min-width: 700px) 700px, 100vw"}]},"width":700,"height":304}}},"tech":["Python","flask","Numpy","Matplotlib","Seaborn","Pandas","Scikit-learn","nltk","Joblib","Docker","Gunicorn","Nginx","AWS"],"github":"https://github.com/Bee0933/Domain-Checker-","external":null,"cta":"https://github.com/Bee0933/Domain-Checker-"},"html":"

A machine leraning classifier web app which can help us detect a potential machines infected by the DGA (Domain Generation Algorithm) malware. Typically machines that are infected tend to generate a bunch of random domain names which will contain one active C C server.

\n

This application guides users on detecting potential DGA (Domain Generation Algorithm) generated malware domains to avoid maleware attack also other numerous purposes including educational purposes.

"}}]}}}