Awesome
Hari Sekhon - Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, Security, AWS, GCP etc
Repo focused on advanced knowledge, tips & tricks, debugging & fixes.
I'm gradually migrating my huge private personal knowledge base into this public repo.
Hit the watch button on the top right for updates.
Some of these pages are still in progress pending porting and populated yet from my private knowledge base pages, some are stubs pending migration.
Much more advanced knowledge is captured in code and code comments. References to my major GitHub Repos are provided throughout where relevant.
References to official docs and some classic books are provided for those who want to thoroughly cover the basics.
Index
<!-- INDEX_START -->- GitHub Repos
- Systems
- Architecture & Documentation
- Git
- Cloud
- Containerization
- Programming
- Infrastructure-as-Code
- Configuration Management
- CI/CD
- Internet Services
- Databases / RDBMS
- NoSQL
- Coordination & Discovery Services
- Pub / Sub & Message Queues
- Data
- Security
- Virtualization
- Hardware
- Networking
- Monitoring
- AI & Automation
- Work
- Miscellaneous
- Star History
- Memes
- More Core Repos
This is the lost documentation.
GitHub Repos
Full of open source tools and scripts used throughout the rest of these docs to make it easier to install and operate these technologies:
- DevOps-Bash-tools - 1000+ Bash scripts, advanced shell environment customizations, quick installation scripts and dot configs
- DevOps-Python-tools - 80+ Python programs for DevOps & Data
- DevOps-Perl-tools - 25+ Perl programs for DevOps
- DevOps-Golang-tools - a handful of Golang programs
- Kubernetes-configs - many Kubernetes applications and advanced templates with Tips & Tricks from production environments
- SQL-scripts - 100+ database scripts
- Templates - templates for many common file formats for programming languages, build systems and DevOps configs
- Diagrams-as-Code - Cloud & Open Source architecture diagrams
This one is used widely throughout these pages:
Systems
Operating Systems
Core Services - DNS, DHCP, SSH, FTP
Editors
Terminal Multiplexers
Architecture & Documentation
- Architecture TODO
- Product Selection TODO
- Diagrams-as-Code
- Documentation
- Microservices TODO
- Medium.com (blog)
- Systems Design
Git
- Git
- Git Repo Hosting Providers:
- GitHub TODO
- GitLab
- Azure DevOps TODO
- Bitbucket TODO
- Pre-Commit
Cloud
Containerization
Docker
- Docker
- Podman
- Dockerfiles for many technologies:
Kubernetes
Kubernetes Core
- Kubernetes
- Kubernetes Upgrades
- Kubernetes Configs
- Kubernetes Production Ready Checklist
- Traefik
- Kong API Gateway
- Istio TODO
- Kubeflow TODO
Cloud Hosted Kubernetes
On-premise Kubernetes
Local Kubernetes Dev
- Docker Desktop embedded Kubernetes (easiest to use)
- MiniKube
- MiniShift - for OpenShift upstream okd
- K3d
- Kind
Kubernetes Applications & Lifecycle Management
Container Registries
- DockerHub
- AWS ECR
- GCP GAR
- GCP GCR (deprecated / shut down)
- Azure ACR
- GitHub GHCR
- Redhat Quay.io (there is an on-prem installable too)
- JFrog Container Registry
- Nexus
- Harbor
- Chart Museum
Container Security
Programming
Languages
- Perl
- Python
- Golang TODO
- Ruby
- R TODO
- TCL / Expect
- JVM:
- APIs
- Regular Expressions
- Testing
Build Systems
Artifact Registries
Code Scanning
Infrastructure-as-Code
Configuration Management
<!-- - [Salt](salt.md) TODO - [Chef](chef.md) TODO -->CI/CD
- CI/CD
- Self-Hosted CI/CD:
- Jenkins
- Jenkins-on-Kubernetes
- HariSekhon/Jenkins - master
Jenkinsfile
template and Groovy Shared Library functions
- TeamCity TODO
- Concourse
- GoCD TODO
- Jenkins
- Git Repo Providers hosted CI/CD:
- GitHub Actions
- GitLab CI TODO
- Azure DevOps TODO
- Bitbucket Pipelines TODO
- 3rd Party hosted CI/CD:
Internet Services
Databases / RDBMS
- SQL TODO
- SQL scripts
- Databases
- Data Warehousing TODO
- MySQL TODO
- PostgreSQL TODO
- Oracle
- CloudBeaver
MPP Databases
Massively Parallel Processing databases - horizontally scaling databases:
Hosted MPP Databases
- Distributed SQL
- Snowflake
- Google BigQuery TODO
- AWS Redshift TODO
See also the Hadoop Ecosystem section further down for more distributed SQL databases.
Database Management
NoSQL
Caching
Search
Coordination & Discovery Services
Pub / Sub & Message Queues
- Pub / Sub & Message Queues
- Kafka
- RabbitMQ
- Celery
- AWS Kinesis
Data
- Data
- Big Data
- Data Warehousing TODO
- Spark TODO
- Airflow TODO
- Apache Camel
- JSON
- Informatica
Data Formats
Hadoop Ecosystem
- Spark TODO
- Kafka
- Hadoop TODO
- Kerberos Hadoop TODO
- YARN TODO
- HDFS TODO
- Pig TODO
- Hive TODO
- Impala TODO
- Presto
- Apache Drill
- Kudu
- Kylin
- Storm TODO
- Mahout
- ZooKeeper
Data Science & Machine Learning
- Data Science TODO
- Machine Learning TODO
- Python
- Anaconda TODO
- R TODO
- Octave TODO
Time Series Databases
Visualization
Security
- Security TODO
- SSL TODO
- Kerberos TODO
- FreeIPA TODO
- Keycloak
- Penetration Testing TODO
- Secrets Managers
- SOC - Security Operations Center
Virtualization
Hardware
Networking
- Networking TODO
- Firewalls
- VPNs
- Cisco TODO
- Juniper TODO
- Foundry TODO
- Keepalived
Load Balancing
- Load Balancing TODO
- HAProxy
- F5
Monitoring
- Monitoring
- Nagios
- Prometheus TODO
- Thanos TODO
- Grafana TODO
- Notifications
- Fluentd
Performance Engineering
AI & Automation
Work
Training & Interview Materials
Banking Industry
Travel
Miscellaneous
Dev / DevOps / Open Source
Vendors
Multimedia
Marketing
Crypto
This section is probably the most financially important thing you'll ever learn.
- Bitcoin
- more financially beneficial than your Tech knowledge
- the most important knowledge along with avoiding feminist divorce law
- Crypto
- every day you're not in crypto you're losing money due to constant inflationary money printing by central banks and governments to fund budgetary deficits caused by universal suffrage spending liabilities
- even many investments, which are also taxed and often confiscated by governments or ex-wives, are losing ground to inflation in real terms
Old Docs
Star History
Memes
From my LinkedIn:
I tried to make these docs as short as possible... but as you can see above, I didn't quite make it.
I've been both the bottom and top of this meme:
More Core Repos
<!-- OTHER_REPOS_START -->Knowledge
<!-- Not support on GitHub Markdown: <iframe src="https://raw.githubusercontent.com/HariSekhon/HariSekhon/main/knowledge.md" width="100%" height="500px"></iframe> Does nothing: <embed src="https://raw.githubusercontent.com/HariSekhon/HariSekhon/main/knowledge.md" width="100%" height="500px" /> -->DevOps Code
<!-- [![Gist Card](https://github-readme-stats.vercel.app/api/gist?id=f8f551332440f1ca8897ff010e363e03)](https://gist.github.com/HariSekhon/f8f551332440f1ca8897ff010e363e03) -->Containerization
CI/CD
DBA - SQL
DevOps Reloaded
Templates
Misc
The rest of my original source repos are here.
Pre-built Docker images are available on my DockerHub.
<!-- 1x1 pixel counter to record hits --> <!-- OTHER_REPOS_END -->