Respected Andra Pradesh chief minister @ncbn sir - please bring reforms in Tirupathi and give priority to devotees who climb the mountain sir .
Make it more easy and a devotional experience for them ! Many climb the mountain and yet wait long hours to see balaji !
๐ 5 signs for a possible correction in the stock market ๐
1) New highs in indices but decreasing number of stocks >200 MA
2) Indices >6% above 50 MA
3) No attractive setups on your watchlist
4) Many exhaustion runs in popular stocks
5) Decreasing number of new highs in stocks
7 signs a stock trend is exhausted ๐๐๐
1) Price >100% above MA 200
2) Largest volume since start of the trend
3) Big gap after several months of rally
4) New highs on lower volume
5) Reversal bar on weekly chart
6) 50% gains in 3 weeks
7) >7 days up in a row
What are the most common ๐จ๐๐ฒ ๐๐ฎ๐๐ฒ๐ ๐ณ๐ผ๐ฟ ๐๐ฎ๐ณ๐ธ๐ฎ?
We have covered lots of concepts around Kafka already. But what are the most common use cases for The System that you are very likely to run into as a Data Engineer?
๐๐ฒ๐โ๐ ๐๐ฎ๐ธ๐ฒ ๐ฎ ๐ฐ๐น๐ผ๐๐ฒ๐ฟ ๐น๐ผ๐ผ๐ธ:
๐ช๐ฒ๐ฏ๐๐ถ๐๐ฒ ๐๐ฐ๐๐ถ๐๐ถ๐๐ ๐ง๐ฟ๐ฎ๐ฐ๐ธ๐ถ๐ป๐ด.
โก๏ธ The Original use case for Kafka by LinkedIn.
โก๏ธ Events happening in the website like page views, conversions etc. are sent via a Gateway and piped to Kafka Topics.
โก๏ธ These events are forwarded to the downstream Analytical systems or processed in Real Time.
โก๏ธ Kafka is used as an initial buffer as the Data amounts are usually big and Kafka guarantees no message loss due to its replication mechanisms.
๐๐ฎ๐๐ฎ๐ฏ๐ฎ๐๐ฒ ๐ฅ๐ฒ๐ฝ๐น๐ถ๐ฐ๐ฎ๐๐ถ๐ผ๐ป.
โก๏ธ Database Commit log is piped to a Kafka topic.
โก๏ธ The committed messages are executed against a new Database in the same order.
โก๏ธ Database replica is created.
๐๐ผ๐ด/๐ ๐ฒ๐๐ฟ๐ถ๐ฐ๐ ๐๐ด๐ด๐ฟ๐ฒ๐ด๐ฎ๐๐ถ๐ผ๐ป.
โก๏ธ Kafka is used for centralized Log and Metrics collection.
โก๏ธ Daemons like FluentD are deployed in servers or containers together with the Applications to be monitored.
โก๏ธ Applications send their Logs/Metrics to the Daemons.
โก๏ธ The Daemons pipe Logs/Metrics to a Kafka Topic.
โก๏ธ Logs/Metrics are delivered downstream to storages like ElasticSearch or InfluxDB for Log/Metrics discovery respectively.
โก๏ธ This is also how you would track your IoT Fleets.
๐ฆ๐๐ฟ๐ฒ๐ฎ๐บ ๐ฃ๐ฟ๐ผ๐ฐ๐ฒ๐๐๐ถ๐ป๐ด.
โก๏ธ This is usually coupled with ingestion mechanisms already covered.
โก๏ธ Instead of piping Data to a certain storage downstream we mount a Stream Processing Framework on top of Kafka Topics.
โก๏ธ The Data is filtered, enriched and then piped to the downstream systems to be further used according to the use case.
โก๏ธ This is also where one would be running Machine Learning Models embedded into a Stream Processing Application.
๐ ๐ฒ๐๐๐ฎ๐ด๐ถ๐ป๐ด.
โก๏ธ Kafka can be used as a replacement for more traditional messaging brokers like RabbitMQ.
โก๏ธ Kafka has better durability guarantees and is easier to configure for several separate Consumer Groups to consume from the same Topic.
โ๏ธHaving said this - always consider the complexity you are bringing with introduction of a Distributed System. Sometimes it is better to just use traditional frameworks.
--------
Follow me to upskill in #MLOps, #MachineLearning, #DataEngineering, #DataScience and overall #Data space.
Also hit ๐to stay notified about new content.
๐๐ผ๐ปโ๐ ๐ณ๐ผ๐ฟ๐ด๐ฒ๐ ๐๐ผ ๐น๐ถ๐ธ๐ฒ ๐, ๐๐ต๐ฎ๐ฟ๐ฒ ๐ฎ๐ป๐ฑ ๐ฐ๐ผ๐บ๐บ๐ฒ๐ป๐!
Join a growing community of Data Professionals by subscribing to my ๐ก๐ฒ๐๐๐น๐ฒ๐๐๐ฒ๐ฟ: https://t.co/qgNCnGtF4A
Only For learning purpose
Thread on how to create 143 strategy and its adjustments. This is monthly strategy in Nifty.
When to initiate: Monday around 10:00 am after monthly expiry is the best time to initiate this.
@Abhay_7788
early days ?
Even now, We literally run our entire backend stack from a single bare metal server, 800$ a month.
- Prod DB
- 77 different services
- Cache
- pub/sub queues
- Task workers
Questions ?
A customer was considering leaving #dynamodb due to costs.
@pj_naylor and I helped them save half a million dollars per year with one simple, magical, optimization.
Want to save DynamoDB costs like a pro? Letโs start with some backgroundโฆ
When you build a local web server listening on a private ip on LAN, only hosts from the same network can access it. Simple networking. Your local network can access outside hosts (thanks to NAT) but outside host canโt directly access it without specific routing logic. A common requirement is exposing this local webserver so it can be accessed from anywhere.
SSH tunneling and ngrok are example of services that allow you to do that. In this post I explain the networking weeds behind how this works.
I explore this in this medium article
"200 years ago, India was the largest economy in the world!!!
A lot of people invaded our country many times, then why Hindu people didn't defend themselves."
Watch Jay Lakhani Ji's one of the most viewed video where he explains 'Why was India conquered so easily.'
The Dockerfile CMD and ENTRYPOINT instructions can be confusing. Here is the most simple example to help explain:
FROM busybox
ENTRYPOINT [ "echo", "[ENTRYPOINT]" ]
CMD [ "[CMD]" ]
If you run the image as is (no options/arguments), the ENTRYPOINT is used as the executable and the CMD is appended as arguments
If you specify arguments at runtime (e.g. docker run image-name FOO), those arguments override the CMD from the Dockerfile
If you specify a new entrypoint at runtime (e.g. docker run --entrypoint=BAR image-name) that will override the ENTRYPOINT and IGNORE the CMD from the Dockerfile
If you specify a new entrypoint AND arguments at runtime (e.g. docker run --entrypoint=BAZ image-name BING) those will be used instead of the values from the Dockerfile.
---
You should specify an ENTRYPOINT if you want the container to use the same executable (but potentially with different arguments) every time.
The CMD should contain the default arguments you want the container to run with.