jhuangtw / xg2xg
by ex-googlers, for ex-googlers - a lookup table of similar tech & services
AI Architecture Analysis
This repository is indexed by RepoMind. By analyzing jhuangtw/xg2xg in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.
Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context on-demand, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.
Embed this Badge
Showcase RepoMind's analysis directly in your repository's README.
Repository Overview (README excerpt)
Crawler viewA handy lookup table of similar technology and services to help ex-googlers survive the *real* world :) pull-requests are very welcomed. __Please do not list any confidential projects!__ For a working example of (some) of these technologies integrated together, see: https://github.com/google/startup-os See also: System Design Primer, The Hadoop Ecosystem Table, Map AWS services to GCP products, Database of Databases, Google Open Source Glossary Technology Core Technology | Google Internal | Google External | Open Source / Real-World | | --------------- | ---------------------------------------- | ---------------------------------------- | | MapReduce | | Apache Hadoop, Spark | | Flume | DataFlow | Apache Beam | | Protocol Buffer | Protobuf, FlatBuffers | Cap'n Proto, Thrift, Avro, Amazon Ion, CBOR, kryo | | Stubby | gRPC | Thrift, Bolt | | Chubby | | Apache Zookeeper, etcd, HashiCorp Consul | | Goops / PubSub | Cloud Pub/Sub | Apache Kafka, Apache Pulsar, Facebook LogDevice | | | | abseil | Infrastructure | Google Internal | Google External | Open Source / Real-World | | -------------------- | ---------------------------------------- | ---------------------------------------- | | Borg | Kubernetes | Apache Mesos, Apache Aurora, HashiCorp Nomad | | GSLB | Cloud Load Balancing - Internal | AWS ELB, Istio, linkerd | OnePlatform | API Gateway | Swagger | | GFE, Maglev, uberproxy | Cloud Load Balancing - HTTPS / External | envoy, AWS ALB, HAProxy, nginx, F5 | | uberproxy (sso proxy) | Identity-Aware Proxy | buzzfeed-sso, Pomerium, Envoy Gateway | | Zanzibar | Zanzibar Research Paper | SpiceDB/authzed, Ory Keto, topaz, Opal, (iam)Keycloak, Warrant, OpenFGA | | data center hardware | open compute | | | Jupiter, Starblaze | | | | B4, Stargate, TE | | | | USPS, Andromeda | | | | ESDN | | Faucet | broccoli man | || Storage | Google Internal | Google External | Open Source / Real-World | | ---------------------------------------- | ---------------------------------------- | ---------------------------------------- | | GFS/Colossus | | HDFS, Ceph, GlusterFS, MooseFS | | Bigtable | Cloud Bigtable | PrestoDB, Cassandra, HBase, Accumulo, DynamoDB, ScyllaDB | | Spanner | Cloud Spanner | Vitess, CockroachDB, TiDB | | ColumnIO / Capacitor | BigQuery storage | Apache Parquet, ORC, Apache Iceberg | | sstable | levelDB | RocksDB, pebble | | zippy | Snappy | lz4 | | RecordIO | Riegeli, TFRecords, & in OR-Tools, szl | stuffed-record-stream | Services | Google Internal | Google External | Open Source | SaaS | | ---------------------------------------- | ---------------------------------------- | ---------------------------------------- | ---------------------------------------- | | Dremel | BigQuery | Apache Drill, Presto, Spark(sort-of), | AWS Athena, Redshift Spectrum, Snowflake | | Dremel UI | | Redash, Metabase, Apache Superset | | | Search (Mustang, Alexandria) | | Elasticsearch, OpenSearch, Solr, Lucene | algolia | | pubsub | pubsub | NATS.io, RabbitMQ, PubNub | AWS SQS/SNS, AWS AppSync | | MillWheel | Cloud Dataflow | Apache Flink, beam | | | Colab | Colaboratory | Jupyter | Observable | | PLX | Google Data Studio | | Mode | | Monarch | paper | | | | Napa | paper | | | | MakerSuite| MakerSuite | | | DevOps | Google Internal | Google External | Real-World | | ------------------------------- | ---------------------------------------- | ---------------------------------------- | | Assimilator | | Dominator | | Blaze | Bazel | Buck, Pants, please.build, Blade, recc, EngFlow, BuildBuddy, flare.build | | Oncall | | PagerDuty, OpsGenie, VictorOps | | varz/borgmon/monarch | Cloud Monitoring | Datadog, Prometheus, M3, librato, newrelic, skylight, scout, Scotty/tricorder, netdata, bosun, also this and this | | Viceroy | Cloud Monitoring | Grafana | | Exception/Error Tracking (thirdeye) | | Sentry.io, Raygun.io, Rollbar, Honeybadger, Airbrake, OverOps, ELK stack | | styleguides | google styleguides | PEP-8, HoundCI auto-style-reviewer | | Sponge | | EngFlow | | Blaze/Forge/TAP/BuildCop | Cloud Build | buildkite, CircleCI, Drone, EngFlow, github, gitlabCI, jenkins, travis | | Forge/ObjFS | | EngFlow, flare.build | | Sandman(test env)/Guitar | | | | Sisyphus / Rapid | | Spinnaker, lambdaCD, screwdriver.cd, CodeShip, shipit-engine, GoCD, AWS CodeDeploy, Capistrano, Fabric, ConcourseCI, samson | | MPM | | Docker, OCI | | borgcfg / gcl, Prodspec + Annealing | Jsonnet, Cue | AWS Cloudformation, Puppet, Chef, Salt, Ansible, Terraform, kubecfg, pulumi, Nix, Pkl | | logging, analog | StackDriver | logstash, fluentd, PaperTrail, cernan, loki | | CodeSearch, Grimoire | Zoekt kythe Code Search (for Google open source code only, with separate UI for Android and Chromium. Go CLI source.) | Sourcegraph, OpenGrok, livegrep | | Critique, Gerrit, Mondrian etc. | Gerrit | Reviewable , Phabricator | | cider | | Eclipse Che, Cloud9, gitpod.io, Coder, Code-Server (VSCode in a Tab), DevZero | | buganizer | Google Issue Tracker | JIRA, bugzilla, github issues, Linear | | Bugjuggler | | SnoozeThis | | ToTT | Google Test Blog | Increment | | Copybara / MOE | Copybara, MOE | | | workflow/dependency management | | Luigi, Airflow, digdag, Pachyderm, Dask | | ErrorProne | ErrorProne | SpotBugs, FindBugs | | Dapper | stackdriver trace | zipkin, OpenTelemetry, jaeger, LightStep, Honeycomb | | C++ Tips of the Week | Abseil C++ Tips of the Week | | | DiRT | | ChaosMonkey, aws fis | | Rosie | | microplane, silver-platter | | API Improvements Proposals | AIP | | | g4 {fix, submit} | | Trunk.io, Graphite | | probers | | cloudprober | | GWP | paper | Parca, Polar Signals | Security | Google Internal | Google External | Open Source | | -------------------------------- | --------------- | ---------------------------------------- | | prodaccess/LOAS | | Keymaster | | prod secrets/identity management | | chamber, knox, SPIFFE | IT / Operations / Misc | Google Internal | Real-World | | ---------------------------------------- | ----------------…