S3cmd is a command-line tool use for uploading, retrieving, and managing data into you s3 bucket. In this tutorial we will discuss how to install s3cmd in Linux. The main purpose of Using s3cmd is we can automate our backup task by making scripts.
This document discusses setting up a Kafka cluster on Amazon Web Services for a big data pipeline. It provides instructions for launching a 3 node Kafka cluster with Zookeeper and two Kafka brokers. Configuration details are given for each broker node and steps are outlined for starting the Zookeeper and Kafka processes, creating a topic, and running a consumer to read from the topic. The purpose of the Kafka cluster is to work with streaming data in a Python Spark application as part of the big data pipeline.
The document provides instructions for installing and configuring OpenERP on Ubuntu, including downloading and installing Ubuntu, installing required packages like PostgreSQL, configuring the PostgreSQL database, downloading and installing the OpenERP server and client, configuring the OpenERP files, and starting the OpenERP server and client.
Ast installation (edited version) shared by voip.com.vnTran Thanh
This document provides instructions for installing and configuring Asterisk for two scenarios: a pure VoIP system and connecting Asterisk to the PSTN. It details downloading required packages, installing dependencies like libpri and zaptel, and extracting, compiling, and configuring Asterisk. It also explains how to start and manage Asterisk using the asterisk command and console commands like help, reload, stop, and exit.
This document provides step-by-step instructions for building a Hadoop cluster on Amazon EC2 using Cloudera. It describes launching an EC2 instance, installing Cloudera Manager, adding instances to the cluster, configuring credentials, and checking that the installation was successful. Once complete, users can access the Hue interface to perform analysis on Hadoop using a SQL-like syntax.
Tacker is an OpenStack-based NFV orchestration framework used to deploy and manage virtual network functions (VNFs). It is compatible with ETSI NFV standards and provides full functionality to orchestrate network services on various virtualized infrastructure managers. Tacker has been accepted into the OpenStack Big Tent project and continues to add new features like VNF scaling, descriptors, and monitoring. Developers are encouraged to contribute by reviewing blueprints, fixing bugs, writing tests, and ensuring ETSI compliance.
Tacker is an OpenStack-based NFV orchestration framework that deploys and operates virtual network functions (VNFs). The presentation summarized Tacker's contributions in the OpenStack Queens release, including multiple flow classifiers per VNF forwarding graph, symmetric VNFFG, VNFFG updating, and a Zabbix plugin for VNF monitoring. It also previewed upcoming features in OpenStack Rocky such as container-based VNFs using Kubernetes, and hybrid VNF deployment across Kubernetes and OpenStack.
The company is switching from CentOS to Slackware because Slackware offers a simpler package management system without dependencies, rolling upgrades to avoid outdated software, and fewer unnecessary packages. It also does not use Systemd, avoiding complexity and incompatibility with their monitoring system. Slackware will allow for a smaller, more compact distro for containers and nodes.
code https://github.com/xebia/scalable-qa-with-docker
Stop wasting time with manual configuration and maintenance
Are you tired of maintaining all your Jenkins slaves and the inconsistency of the setup? We need to become aware that it’s inefficient to keep all the environments, browsers and dependencies up to date manually.
During this session the attendees will be introduced to setting up scalable and solid test environments with practical examples using selenium, mesos and docker.
Key takeaways
How to build and scale the Selenium Grid(s) using Docker and Mesos?
How to setup a scalable cluster to run specific test environments in no-time?
How to leverage the mesos cluster to test with other frameworks than selenium?
This document provides instructions for setting up the Aegir hosting platform on a Linux server. It discusses what Aegir is, its history and requirements. It then provides step-by-step instructions for installing Aegir, which includes setting up the server with LAMP stack, creating an Aegir user, configuring Apache virtual hosts, installing Aegir from Git, configuring the database, and completing the Aegir installation wizard. Finally, it discusses creating a super administrator for Aegir and the file structure once Aegir is installed.
The document discusses orchestration using Tutum, a hosted container orchestration service. It introduces Tutum and its features, such as spreading services across nodes, making efficient use of nodes, inter-host communication, deployment to specific nodes, APIs, monitoring, and logging. It explains that after 3 months of experimenting with various orchestration tools, Tutum met all of its needs for orchestration, abstraction of complexities, and powerful APIs. Finally, it provides some pros and cons of Tutum, noting that while it is easy to use and fully featured with great support, it does have vendor lock-in and is not self-hosted.
Retrofit uses OkClient for the Http operations, but caching is possible only in OkHttpClient. Here I have explained how to cache the response by changing the headers.
This document contains the agenda for the SUSE Expert Day 2019 event. The agenda includes:
- A breakfast and welcome from 09:00-09:45
- An introduction and overview of the agenda from 09:50-10:00
- Presentations on the SUSE beta program, new SUSE Manager features, OpenStack strategies, Ceph architectures, SAP automation with Terraform, CAASP and CAP, SLES release processes, and OpenQA testing methods throughout the day
- Networking over lunch from 12:15-13:30
This document provides an overview of ZFS replication. It describes the setting and flow, including connecting the primary and secondary systems, creating snapshots on the primary, and using zfs send and receive commands over SSH to replicate snapshots from the primary to the secondary. Software components include utilities for rsync, SSH, and managing ZFS replication through APIs. A simple demonstration shows generating an SSH key, copying it to the secondary, taking a snapshot, and replicating it.
The document discusses different ways to organize systems for production including organizing delivery and teams, organizing systems in space using orchestration, and organizing systems over time through reconciliation. It also mentions various technologies used in orchestration and deployment of systems including Kubernetes, Neo4j, consoles, and cloud providers.
This document discusses configuring HTCondor to flock jobs between two HTCondor pools running on different cloud platforms. It describes installing HTCondor on a Windows Server 2008 machine on Rackspace as pool 1 and another on Amazon EC2 as pool 2. It then explains modifying the condor_config file on both pools to specify the other pool's Central Manager IP address in the FLOCK_FROM and FLOCK_TO statements, allowing jobs to flock between the two pools. Testing shows the flocking works as each pool can see and submit jobs to the other.
My early experience with Mirantis OpenStack 6.0Guy Tel-Zur
The document summarizes the author's early experience deploying Mirantis OpenStack 6 in a VirtualBox virtual environment on their laptop. It describes downloading the ISO image, running Fuel to deploy 4 VMs in a master-slave configuration with Ceph storage. The cloud infrastructure is deployed, which takes a long time, and then the author accesses the OpenStack portal and launches their first instance, accessing the console.
This document discusses using AWS Systems Manager Run Command to run Ansible playbooks on AWS instances. It provides steps to package the Ansible code in an S3 bucket, configure target instances with SSM agent and required permissions, run the Ansible playbook via the SSM RunCommand specifying the S3 URL, and view logs of the run in the S3 bucket or EC2 console. Benefits of using SSM for deployments include eliminating SSH key management, centralized logging across instances, and security features like IAM roles and policies.
Writing Serverless Application in Java with comparison of 3 approaches: AWS S...Andrew Zakordonets
This presentation is from my Meetup talks about how we were building Serverless Application using Java and Step Functions. It contains some comparison of 3 different approaches on how you can build Java with Serverless : AWS SDK, Micronaut and Spring.
This document discusses automating EC2 operations on AWS through auto backup, auto patching, and auto recovery. Auto backup uses AWS Backup to create AMIs of EC2 instances on a scheduled basis. Auto patching uses AWS Systems Manager Patch Manager to patch EC2 instances on a schedule. Auto recovery monitors CloudWatch alarms and metrics, and uses Lambda, SNS, and Run Command to restart processes or instances when issues are detected. The goal of automation is to make operations easier and allow time to be used for other tasks.
Puppet Camp Sydney 2015: Sneak peek into the Puppet environment at Fairfax MediaPuppet
This document summarizes the puppet environment at Fairfax Media/Domain Group. It describes their history with puppet and lessons learned, including not making direct changes to the puppet master and defining a standard workflow. It outlines their current architecture which uses tools like Packer, Puppetlabs R10k, and a custom Ruby service called Captain Hook to deploy changes across a high availability puppet master infrastructure. It also describes their process for standardizing modules and using a Git feature branch workflow and CloudFormation for infrastructure automation.
Jenkins can be used to automate the software development code pipeline using a Domain Specific Language (DSL) scripted in Groovy, which provides flexibility. A Jenkins pipeline consists of three main parts - building and testing the software artifact, assuring quality, and orchestrating deployment to different environments like development, staging, and production. Quality assurance checks are run at each stage of the deployment process.
Usually we launch hundreds of instances in AWS for day to day work. As long as they are accessible from our hosts (probably a RHEL or Ubuntu or your own mac), we are good to go. But there are some instances where you might get a patch from IT for your host. Once you apply the patch, you realize that you are unable to access your AWS instances anymore. And your IT team doesn't have any clue on what happened. You contact AWS support, and they say it all looks good. So how do you proceed from this scenario? Where to start and what to do. This talk goes through all the steps starting with most basic checks all the way to updating the crypto key exchange algorithms on your host.
This presentation was provided by Nicole 'Nici" Pfeiffer of the Center for Open Science (COS), during the first session of our 2025 NISO training series "Secrets to Changing Behavior in Scholarly Communications." Session One was held June 5, 2025.
*Order Hemiptera:*
Hemiptera, commonly known as true bugs, is a large and diverse order of insects that includes cicadas, aphids, leafhoppers, and shield bugs. Characterized by their piercing-sucking mouthparts, Hemiptera feed on plant sap, other insects, or small animals. Many species are significant pests, while others are beneficial predators.
*Order Neuroptera:*
Neuroptera, also known as net-winged insects, is an order of insects that includes lacewings, antlions, and owlflies. Characterized by their delicate, net-like wing venation and large, often prominent eyes, Neuroptera are predators that feed on other insects, playing an important role in biological control. Many species have aquatic larvae, adding to their ecological diversity.
The company is switching from CentOS to Slackware because Slackware offers a simpler package management system without dependencies, rolling upgrades to avoid outdated software, and fewer unnecessary packages. It also does not use Systemd, avoiding complexity and incompatibility with their monitoring system. Slackware will allow for a smaller, more compact distro for containers and nodes.
code https://github.com/xebia/scalable-qa-with-docker
Stop wasting time with manual configuration and maintenance
Are you tired of maintaining all your Jenkins slaves and the inconsistency of the setup? We need to become aware that it’s inefficient to keep all the environments, browsers and dependencies up to date manually.
During this session the attendees will be introduced to setting up scalable and solid test environments with practical examples using selenium, mesos and docker.
Key takeaways
How to build and scale the Selenium Grid(s) using Docker and Mesos?
How to setup a scalable cluster to run specific test environments in no-time?
How to leverage the mesos cluster to test with other frameworks than selenium?
This document provides instructions for setting up the Aegir hosting platform on a Linux server. It discusses what Aegir is, its history and requirements. It then provides step-by-step instructions for installing Aegir, which includes setting up the server with LAMP stack, creating an Aegir user, configuring Apache virtual hosts, installing Aegir from Git, configuring the database, and completing the Aegir installation wizard. Finally, it discusses creating a super administrator for Aegir and the file structure once Aegir is installed.
The document discusses orchestration using Tutum, a hosted container orchestration service. It introduces Tutum and its features, such as spreading services across nodes, making efficient use of nodes, inter-host communication, deployment to specific nodes, APIs, monitoring, and logging. It explains that after 3 months of experimenting with various orchestration tools, Tutum met all of its needs for orchestration, abstraction of complexities, and powerful APIs. Finally, it provides some pros and cons of Tutum, noting that while it is easy to use and fully featured with great support, it does have vendor lock-in and is not self-hosted.
Retrofit uses OkClient for the Http operations, but caching is possible only in OkHttpClient. Here I have explained how to cache the response by changing the headers.
This document contains the agenda for the SUSE Expert Day 2019 event. The agenda includes:
- A breakfast and welcome from 09:00-09:45
- An introduction and overview of the agenda from 09:50-10:00
- Presentations on the SUSE beta program, new SUSE Manager features, OpenStack strategies, Ceph architectures, SAP automation with Terraform, CAASP and CAP, SLES release processes, and OpenQA testing methods throughout the day
- Networking over lunch from 12:15-13:30
This document provides an overview of ZFS replication. It describes the setting and flow, including connecting the primary and secondary systems, creating snapshots on the primary, and using zfs send and receive commands over SSH to replicate snapshots from the primary to the secondary. Software components include utilities for rsync, SSH, and managing ZFS replication through APIs. A simple demonstration shows generating an SSH key, copying it to the secondary, taking a snapshot, and replicating it.
The document discusses different ways to organize systems for production including organizing delivery and teams, organizing systems in space using orchestration, and organizing systems over time through reconciliation. It also mentions various technologies used in orchestration and deployment of systems including Kubernetes, Neo4j, consoles, and cloud providers.
This document discusses configuring HTCondor to flock jobs between two HTCondor pools running on different cloud platforms. It describes installing HTCondor on a Windows Server 2008 machine on Rackspace as pool 1 and another on Amazon EC2 as pool 2. It then explains modifying the condor_config file on both pools to specify the other pool's Central Manager IP address in the FLOCK_FROM and FLOCK_TO statements, allowing jobs to flock between the two pools. Testing shows the flocking works as each pool can see and submit jobs to the other.
My early experience with Mirantis OpenStack 6.0Guy Tel-Zur
The document summarizes the author's early experience deploying Mirantis OpenStack 6 in a VirtualBox virtual environment on their laptop. It describes downloading the ISO image, running Fuel to deploy 4 VMs in a master-slave configuration with Ceph storage. The cloud infrastructure is deployed, which takes a long time, and then the author accesses the OpenStack portal and launches their first instance, accessing the console.
This document discusses using AWS Systems Manager Run Command to run Ansible playbooks on AWS instances. It provides steps to package the Ansible code in an S3 bucket, configure target instances with SSM agent and required permissions, run the Ansible playbook via the SSM RunCommand specifying the S3 URL, and view logs of the run in the S3 bucket or EC2 console. Benefits of using SSM for deployments include eliminating SSH key management, centralized logging across instances, and security features like IAM roles and policies.
Writing Serverless Application in Java with comparison of 3 approaches: AWS S...Andrew Zakordonets
This presentation is from my Meetup talks about how we were building Serverless Application using Java and Step Functions. It contains some comparison of 3 different approaches on how you can build Java with Serverless : AWS SDK, Micronaut and Spring.
This document discusses automating EC2 operations on AWS through auto backup, auto patching, and auto recovery. Auto backup uses AWS Backup to create AMIs of EC2 instances on a scheduled basis. Auto patching uses AWS Systems Manager Patch Manager to patch EC2 instances on a schedule. Auto recovery monitors CloudWatch alarms and metrics, and uses Lambda, SNS, and Run Command to restart processes or instances when issues are detected. The goal of automation is to make operations easier and allow time to be used for other tasks.
Puppet Camp Sydney 2015: Sneak peek into the Puppet environment at Fairfax MediaPuppet
This document summarizes the puppet environment at Fairfax Media/Domain Group. It describes their history with puppet and lessons learned, including not making direct changes to the puppet master and defining a standard workflow. It outlines their current architecture which uses tools like Packer, Puppetlabs R10k, and a custom Ruby service called Captain Hook to deploy changes across a high availability puppet master infrastructure. It also describes their process for standardizing modules and using a Git feature branch workflow and CloudFormation for infrastructure automation.
Jenkins can be used to automate the software development code pipeline using a Domain Specific Language (DSL) scripted in Groovy, which provides flexibility. A Jenkins pipeline consists of three main parts - building and testing the software artifact, assuring quality, and orchestrating deployment to different environments like development, staging, and production. Quality assurance checks are run at each stage of the deployment process.
Usually we launch hundreds of instances in AWS for day to day work. As long as they are accessible from our hosts (probably a RHEL or Ubuntu or your own mac), we are good to go. But there are some instances where you might get a patch from IT for your host. Once you apply the patch, you realize that you are unable to access your AWS instances anymore. And your IT team doesn't have any clue on what happened. You contact AWS support, and they say it all looks good. So how do you proceed from this scenario? Where to start and what to do. This talk goes through all the steps starting with most basic checks all the way to updating the crypto key exchange algorithms on your host.
This presentation was provided by Nicole 'Nici" Pfeiffer of the Center for Open Science (COS), during the first session of our 2025 NISO training series "Secrets to Changing Behavior in Scholarly Communications." Session One was held June 5, 2025.
*Order Hemiptera:*
Hemiptera, commonly known as true bugs, is a large and diverse order of insects that includes cicadas, aphids, leafhoppers, and shield bugs. Characterized by their piercing-sucking mouthparts, Hemiptera feed on plant sap, other insects, or small animals. Many species are significant pests, while others are beneficial predators.
*Order Neuroptera:*
Neuroptera, also known as net-winged insects, is an order of insects that includes lacewings, antlions, and owlflies. Characterized by their delicate, net-like wing venation and large, often prominent eyes, Neuroptera are predators that feed on other insects, playing an important role in biological control. Many species have aquatic larvae, adding to their ecological diversity.
Rose Cultivation Practices by Kushal Lamichhane.pdfkushallamichhame
This includes the overall cultivation practices of Rose prepared by:
Kushal Lamichhane (AKL)
Instructor
Shree Gandhi Adarsha Secondary School
Kageshowri Manohara-09, Kathmandu, Nepal
RE-LIVE THE EUPHORIA!!!!
The Quiz club of PSGCAS brings to you a fun-filled breezy general quiz set from numismatics to sports to pop culture.
Re-live the Euphoria!!!
QM: Eiraiezhil R K,
BA Economics (2022-25),
The Quiz club of PSGCAS
How to Manage Maintenance Request in Odoo 18Celine George
Efficient maintenance management is crucial for keeping equipment and work centers running smoothly in any business. Odoo 18 provides a Maintenance module that helps track, schedule, and manage maintenance requests efficiently.
Artificial intelligence Presented by JM.jmansha170
AI (Artificial Intelligence) :
"AI is the ability of machines to mimic human intelligence, such as learning, decision-making, and problem-solving."
Important Points about AI:
1. Learning – AI can learn from data (Machine Learning).
2. Automation – It helps automate repetitive tasks.
3. Decision Making – AI can analyze and make decisions faster than humans.
4. Natural Language Processing (NLP) – AI can understand and generate human language.
5. Vision & Recognition – AI can recognize images, faces, and patterns.
6. Used In – Healthcare, finance, robotics, education, and more.
Owner By:
Name : Junaid Mansha
Work : Web Developer and Graphics Designer
Contact us : +92 322 2291672
Email : [email protected]
Human Anatomy and Physiology II Unit 3 B pharm Sem 2
Respiratory system
Anatomy of respiratory system with special reference to anatomy
of lungs, mechanism of respiration, regulation of respiration
Lung Volumes and capacities transport of respiratory gases,
artificial respiration, and resuscitation methods
Urinary system
Anatomy of urinary tract with special reference to anatomy of
kidney and nephrons, functions of kidney and urinary tract,
physiology of urine formation, micturition reflex and role of
kidneys in acid base balance, role of RAS in kidney and
disorders of kidney
How to Manage Upselling of Subscriptions in Odoo 18Celine George
Subscriptions in Odoo 18 are designed to auto-renew indefinitely, ensuring continuous service for customers. However, businesses often need flexibility to adjust pricing or quantities based on evolving customer needs.
Pests of Rice: Damage, Identification, Life history, and Management.pptxArshad Shaikh
Rice pests can significantly impact crop yield and quality. Major pests include the brown plant hopper (Nilaparvata lugens), which transmits viruses like rice ragged stunt and grassy stunt; the yellow stem borer (Scirpophaga incertulas), whose larvae bore into stems causing deadhearts and whiteheads; and leaf folders (Cnaphalocrocis medinalis), which feed on leaves reducing photosynthetic area. Other pests include rice weevils (Sitophilus oryzae) and gall midges (Orseolia oryzae). Effective management strategies are crucial to minimize losses.
Completed Sunday 6/8. For Weekend 6/14 & 15th. (Fathers Day Weekend US.) These workshops are also timeless for future students TY. No admissions needed.
A 9th FREE WORKSHOP
Reiki - Yoga
“Intuition-II, The Chakras”
Your Attendance is valued.
We hit over 5k views for Spring Workshops and Updates-TY.
Thank you for attending our workshops.
If you are new, do welcome.
Grad Students: I am planning a Reiki-Yoga Master Course (As a package). I’m Fusing both together.
This will include the foundation of each practice. Our Free Workshops can be used with any Reiki Yoga training package. Traditional Reiki does host rules and ethics. Its silent and within the JP Culture/Area/Training/Word of Mouth. It allows remote healing but there’s limits As practitioners and masters, we are not allowed to share certain secrets/tools. Some content is designed only for “Masters”. Some yoga are similar like the Kriya Yoga-Church (Vowed Lessons). We will review both Reiki and Yoga (Master tools) in the Course upcoming.
S9/This Week’s Focus:
* A continuation of Intuition-2 Development. We will review the Chakra System - Our temple. A misguided, misused situation lol. This will also serve Attunement later.
Thx for tuning in. Your time investment is valued. I do select topics related to our timeline and community. For those seeking upgrades or Reiki Levels. Stay tuned for our June packages. It’s for self employed/Practitioners/Coaches…
Review & Topics:
* Reiki Is Japanese Energy Healing used Globally.
* Yoga is over 5k years old from India. It hosts many styles, teacher versions, and it’s Mainstream now vs decades ago.
* Anything of the Holistic, Wellness Department can be fused together. My origins are Alternative, Complementary Medicine. In short, I call this ND. I am also a metaphysician. I learnt during the 90s New Age Era. I forget we just hit another wavy. It’s GenZ word of Mouth, their New Age Era. WHOA, History Repeats lol. We are fusing together.
* So, most of you have experienced your Spiritual Awakening. However; The journey wont be perfect. There will be some roller coaster events. The perks are: We are in a faster Spiritual Zone than the 90s. There’s more support and information available.
(See Presentation for all sections, THX AGAIN.)
Diptera: The Two-Winged Wonders, The Fly Squad: Order Diptera.pptxArshad Shaikh
Diptera, commonly known as flies, is a large and diverse order of insects that includes mosquitoes, midges, gnats, and horseflies. Characterized by a single pair of wings (hindwings are modified into balancing organs called halteres), Diptera are found in almost every environment and play important roles in ecosystems as pollinators, decomposers, and food sources. Some species, however, are significant pests and disease vectors, transmitting diseases like malaria, dengue, and Zika virus.
Ray Dalio How Countries go Broke the Big CycleDadang Solihin
A complete and practical understanding of the Big Debt Cycle. A much more practical understanding of how supply and demand really work compared to the conventional economic thinking. A complete and practical understanding of the Overall Big Cycle, which is driven by the Big Debt Cycle and the other major cycles, including the big political cycle within countries that changes political orders and the big geopolitical cycle that changes world orders.
A short update and next week. I am writing both Session 9 and Orientation S1.
As a Guest Student,
You are now upgraded to Grad Level.
See Uploads for “Student Checkin” & “S8”. Thx.
Thank you for attending our workshops.
If you are new, do welcome.
Grad Students: I am planning a Reiki-Yoga Master Course (As a package). I’m Fusing both together.
This will include the foundation of each practice. Our Free Workshops can be used with any Reiki Yoga training package. Traditional Reiki does host rules and ethics. Its silent and within the JP Culture/Area/Training/Word of Mouth. It allows remote healing but there’s limits As practitioners and masters. We are not allowed to share certain secrets/tools. Some content is designed only for “Masters”. Some yoga are similar like the Kriya Yoga-Church (Vowed Lessons). We will review both Reiki and Yoga (Master tools) in the Course upcoming.
Session Practice, For Reference:
Before starting a session, Make sure to check your environment. Nothing stressful. Later, You can decorate a space as well.
Check the comfort level, any needed resources (Yoga/Reiki/Spa Props), or Meditation Asst?
Props can be oils, sage, incense, candles, crystals, pillows, blankets, yoga mat, any theme applies.
Select your comfort Pose. This can be standing, sitting, laying down, or a combination.
Monitor your breath. You can add exercises.
Add any mantras or affirmations. This does aid mind and spirit. It helps you to focus.
Also you can set intentions using a candle.
The Yoga-key is balancing mind, body, and spirit.
Finally, The Duration can be long or short.
Its a good session base for any style.
Next Week’s Focus:
A continuation of Intuition Development. We will review the Chakra System - Our temple. A misguided, misused situation lol. This will also serve Attunement later.
For Sponsor,
General updates,
& Donations:
Please visit:
https://ldmchapels.weebly.com
2. S3cmd is a command-line tool for uploading, retrieving, and managing data into you s3
bucket. In this tutorial we will discuss how to install s3cmd in Linux. The main purpose of
Using s3cmd is we can automate our backup task by making scripts. If you want to mount
your s3 bucket with your local instance read our tutorial how to mount S3 bucket with ec2
instance.
The following step will help you to install S3cmd in Linux. Let’s do it.
Step 1. Install s3cmd into Linux
S3cmd package is by default available into Ubuntu repository first update repository then
you can simply install the package by executing following command.
Apt-get clean
Apt-get update
We will install s3cmd with pip so install pip first
apt-get install python-pip
pip install --upgrade setuptools
when you will run above command it will ask for pip upgradation.
pip install --upgrade pip
3. mkdir /s3cmd
cd /s3cmd
Downloadthe package of s3cmd thenunzip
wget https://codeload.github.com/s3tools/s3cmd/zip/master
If unzipis notinstalledfirst install that
apt install unzip
unzip master
cd s3cmd-master
whenyouwill unzipthe s3cmdpackage youwill findthere executingscriptjustrunthat scriptyour
s3cmd will install.
pythonsetup.pyinstall
If you wantto check that s3cms installedornotyoucan check it’sversion.
4. We have successfullyinstalleds3cmd.Butour taskis notcompletedyetbecause ours3cmd
configurationispending.Rememberonthingit’sdependsonyourrequirementyouwantto
configure s3cmdfromroot useryou can do or from anotheruserlike myrequirementis from
linuxdadyusersoIam doingfromthisuseryou can do accordingly.
adduser linuxdady
passwd linuxdady
su - linuxdady
Afteraddinguserlet’sconfigure s3cmd
If you wantto configure s3cmdyou needyouraccesskeyand secretkeydownloadfromawsconsole
first.
s3cmd configure
Enter youraccess keyandleave restdefaultjusthitenter.
Nowwe have completelyconfiguredours3cmdlet’s use s3cmd
s3cmd ls
thiscommandwill showyourall presentbucketinyours3.
If you wantto create newbucketwiths3cmdyoucan do thatbut rememberonthingsyoubucket
name shouldbe unique.
s3cmd mb s3://linux-certified
Our newbucketlinux-certifiedhasbeencreatednow checkyourawsconsole forverification.
5. Upload file intoourbucket
We have a testing.txtfile thatwe wanttouploadintoour Linux-certifiedbucket.
s3cmd put testing.txt s3://linux-certified
upload: 'testing.txt' -> 's3://linux-certified/testing.txt'[1 of
1] 24 of 24 100% in 0s 52.83 B/s done
Uploadcomplete directoryintoourbucket.
Rememberone thingdon’tuse /afteryourdirectoryname because itwill uploadonlyyourdirectory
content.
s3cmd put -r LogFile s3://linux-certified
upload: 'LogFile/a' -> 's3://linux-certified/LogFile/a' [1 of 8]
24 of 24 100% in 0s 54.75 B/s done
upload: 'LogFile/a' -> 's3://linux-certified/LogFile/a' [1 of 8]
24 of 24 100% in 0s 308.75 B/s done
List yourbucketdata
s3cmd ls s3://linux-certified
DIR s3://linux-certified/LogFile/
2019-04-16 00:49 24 s3://linux-certified/testing.txt
The above out put showsthatwe have on directoryLogFile inourbucketandone testing.txtfile.You
can cross verifyfromaws S3 console.
Downloadyourfile anddirectoryfrombucket.
s3cmd get s3://linux-certified/testing.txt
s3cmd get -r s3://linux-certified/LogFile
6. s3cmd del s3://linux-certified/testing.txt
delete: 's3://linux-certified/testing.txt'
s3cmd del -r s3://linux-certified/LogFile
delete: 's3://linux-certified/LogFile/a'
delete: 's3://linux-certified/LogFile/b'
Remove yourbucketpermanently
Note downone thingIf you wantto delete yourbucketcompletelythenyourbucketshouldbe
emptyotherwise itwill notdelete yourbucketandwill prompterror“yourbucketisnot empty”.
s3cmd rb s3://linux-certified
Bucket 's3://linux-certified/' removed
Sync data betweenlocal directoryandyours3 bucket
Let’ssuppose Ihave LogFile directoryintomyS3 bucket andsync thisdirectorywith/tmp/data
directorythenfollowgivenstep
s3cmd sync s3://linux-certified/LogFile /tmp/data
download: 's3://linux-certified/LogFile/a' -> '/tmp/data/LogFile/a'[1
of 5] 24 of 24 100% in 0s 2.34 KB/s done
download: 's3://linux-certified/LogFile/e' -> '/tmp/data/LogFile/e' [2
of 5] 0 of 0 0% in 0s 0.00 B/s done
Copydata from one buckettoanotherbucket
s3cmd sync s3://linux-certified/ s3://linuxdady/
7. Conclusion
In thistutorial we have install s3cmdand explainedoverview of S3cmd.Youcan performall s3
buckettaskwiththe helpof s3cmd andyou can automate yourtask like backup,bucketcreation,
bucketdeletion,dataupload,datadownload,datacopyformsone bucketto anotheretc.etc. with
the helpof s3cmd and youcan save yourvaluable time.