Skip to main content

Posts

Essential GCP services for a new age application

Identity and resource management IAM  Identity aware proxy Resource Manager Stackdriver Monitoring Stackdriver Monitoring: Infrastructure and application monitoring Stackdriver Logging: Centralized logging Stackdriver Error Reporting: Application error reporting Stackdriver Trace: Application performance insights (latency) Stackdriver Debugger: Live production debugging Development management Cloud Deployment Manager: Templated Infrastructure deployment Cloud Console: Web based management console Cloud shell: Browser based terminal/CLI Development tools Cloud SDK: CLI for GCP Container registry: Private container registry Container builder: Build/Package container artifacts Cloud source repository: Hosted private git repository Database services Cloud SQL: Managed MySQL and PostgreSQL Cloud BigTable: HBase compatible non-relational DB Cloud Datastore: Horizontally scalable non-relational (ACID) Cloud Spanner: Horizontally scalable relation...

GCP - BigQuery Roles

GCP BigQuery Roles (Quick view)

GCP: GAE - Memcache best practices

Memcache is a distributed in-memory data cache in front of or in place of robust persistent storage for some tasks. GAE includes a memory cache service for this purpose. Best practices for using memcache: 1. Handling memcache API failures gracefully; Do not expose errors to the end users 2. Use batching capability of the API when possible 3. Distribute load across your memcache keyspace Use sharding and aggregating for improving performance efficiency. Use TTL (expiration policy) to make sure the memcache does not fill-up indefinitely Use getIdentifiable() and putIfUntouched() for managing the values that may get affected by concurrent updates Use batching (getMulti ("comments", "commented_by") ) to fetch related values together instead of one by one Use graceful error handling

GCP_QuickRef01

1. Signed URL is a method of granting temporary access to cloud storage/object via a link 2. How long all non-admin activity logs are kept - 7 days (Basic tier), 30 days (Premium tier) 3. What kind of access is preferred on GCS buckets - IAM Roles, to control access at the object level ACL permissions would come handy 4. VPN routing options - Dynamic BGP based, Route based, Policy based 5. If the object versioning is enabled, when the object is deleted, the deleted object is archived 6. What are the available file formats for exporting billing info to cloud storage - csv,json 7. Service accounts are the non-human IAM account, used for programmatic and application access on GCP resources 8. Environments that Stackdriver can natively monitor are - GCP and AWS 9. Persistent disks (Standard and SSD) and Local SSD 10. Method for automatically applying conditions on cloud storage buckets for deletion and changing storage class is Lifecycle management 11. Organization owner is a ro...

Infrastructure specific terms

SAN: Enhance storage devices - Disk arrays and tapes SANs make disk arrays and tape libraries accessible to servers so that the devices appear to the OS as locally attached devices; SAN is a separate network of storage devices not accessible through LAN by other devices. NAS: A single device or server or computing appliance, sharing its own storage over the network. iSCSI: Transports block-level data between an iSCSI initiator on a server and and iSCSI target on a storage device. The protocol encapsulates SCSI commands, assembles the data packets for the TCP/IP layer. Packets are transferred using point-to-point connection. Bastion host is a special purpose computer on a network specifically designed and configured to withstand attacks, generally hosts single application. Ex. a proxy server, and all other services are removed or limited to reduce the threat to the computer. Source: Wikipedia

RAID Levels: Redundant Array of Independent Disks

Standard RAID levels comprise of configurations that employ the techniques of * STRIPING * MIRRORING * PARITY  to create large reliable data stores using general purpose HDDs. Levels are standardized by SNIA (Storage Networking Industry Association) in Common RAID Disk Drive Format (DDF) RAID 0 >> STRIPING (No fail-over, No Redundancy, Total loss of information if disk fails, each disk size will be of smallest disk size in the set of the disks) RAID 1 and its variants >> MIRRORING (Copy of write will be in more than one disk, Redundancy, less performant) RAID 5 >> Distributed PARITY RAID 6 >> Dual PARITY Source:   Wikipedia

Sub-netting: Divide a network into 2 or more networks

Points to keep in mind: 1. Computers that belong to a subnet are addressed with an identical most-sig bit group in the IP addresses 2. IP is logically divided into NetworkIdentifier/Routingprefix and Restfield/HostIdentifier 3. Routing prefix can be expressed as CIDR (Classless Inter-Domain Routing) notation. Ex. 198.51.100.0/24 Implies NetworkIdentifier has 24 bits allocated and Rest field has 8 bits allocated 4. A network is characterized by subnet mask or netmask, applied by bitwise AND operation Ex. For 198.51.100.0/24, the subnet mask is 255.255.255.0 Subnet masks are used to identify the networks *If 198.51.100.0 is NetworkIdentifier, then 198.51.100.255 is BroadcastIdentifier For Class A, mask is 255.0.0.0; Class B, mask is 255.255.0.0; Class C, mask is 255.255.255.0 5. Traffic is exchanged between subnets through routers, when the routing prefixes of the source and destination addresses differ; A router serves as a logical boundary between the subnets. Advantag...