AWS

Amazon Web Services (AWS), is a collection of remote computing services, also called web services, that make up a cloud-computing platform  operated from 11 geographical regions across the world. The most central and well-known of these services include Amazon Elastic Compute Cloud, also known as "EC2", and Amazon Simple Storage Service, also known as "S3". Other services include Elastic MapReduce (EMR), Route 53 (a DNS web service),  provides a highly available and scalable Domain Name System (DNS) web service, Virtual Private Cloud (VPC), storage, database, deployment and application services.

Share tech news, updates, or what's on your mind.

Sign up to Post

Hi Experts,

I get the following errors with docker compose up

root@ip-10-252-14-11:/home/ubuntu/workarea/sourcecode/harvest-trove# docker-compose up
Recreating harvest-trove_harvest-trove_1 ... done
Creating harvest-trove_trove_review_1    ...
Creating harvest-trove_trove_pull_1      ... error
Creating harvest-trove_trove_push_1      ...
Creating harvest-trove_trove_process_1   ...

ERROR: for harvest-trove_trove_pull_1  Cannot start service trove_pull: invalid header field value "oci runtime error: container_linux.go:247: starting container procesCreating harvest-trove_trove_process_1   ... error

Creating harvest-trove_trove_push_1      ... error
Creating harvest-trove_trove_review_1    ... error

ERROR: for harvest-trove_trove_push_1  Cannot start service trove_push: invalid header field value "oci runtime error: container_linux.go:247: starting container process caused \"exec: \\\"harvest-trove:1.0.3\\\": executable file not found in $PATH\"\n"

ERROR: for harvest-trove_trove_review_1  Cannot start service trove_review: invalid header field value "oci runtime error: container_linux.go:247: starting container process caused \"exec: \\\"harvest-trove:1.0.3\\\": executable file not found in $PATH\"\n"

ERROR: for trove_pull  Cannot start service trove_pull: invalid header field value "oci runtime error: container_linux.go:247: starting container process caused \"exec: \\\"harvest-trove:1.0.3\\\": executable file not found in $PATH\"\n"

ERROR: for trove_process 

Open in new window

0
Do You Have a Trusted Wireless Environment?
Do You Have a Trusted Wireless Environment?

A Trusted Wireless Environment is a framework for building a complete Wi-Fi network that is fast, easy to manage, and secure.

I am getting an error after uploading a Theme to Wordpress hosted on AWS.  Has anyone seen this before and know how to fix it?

Can't connect to AWS! Check your credentials and make sure your AWS accout is active!

I know account is spelled wrong.  That is how it is spelled in the error.
0
How DLP should be implemented in various SaaS solutions?

A bullet point response would be great.


Thanks,
0
Hi Experts,

     I had build and run a docker image like this.

docker build -t harvest-trove:1.0.3 .
docker run --name trove_pull ${trove_environment[@]} -d -restart always harvest-trove:1.0.3 start pull                 

Open in new window


I want to use docker compose for the above two commands

I had created the docker compose like this.

version:'3'
services:
   harvest-trove:
      build: .
      image: harvest-trove:1.0.3
      volumes:
                -  .:/home/trove
           env_file:
        -  web-variables.env
            command: python3 manage.py migrate
  trove-pull:
    container_name:trove-pull     
    image: harvest-trove
    env_file:
       - web-variables.env
       depends_on:
         - harvest-trove
       command: harvest-trove:1.0.3 start pull
       restart:always

Open in new window


when I run docker-compose up I get the following error.

error with docker-compose up
Please help me in fixing this issue.

With Many thanks,
Bharath AK
0
Apologies if I'm out-of-line posting this kind of question... and I looked in EE to see if I could find a "Community" forum for off-the-wall discussions... (There used to be one, yes?)

But my question relates to investing in NTNX stock.  Cheerleaders of it say that it'll be huge - but I can barely even find out what they do, aside from the bland descriptions relating to simplifying cloud deployments... Is it a platform like AWS or Azure?  How is it so revolutionary?  Has it got a solid future?

Please feel free to point me to another forum if needed... just not sure where to start here with this question... or whether to pursue it at all on EE.

Thanks!
0
Hi,

is experts exchange good for terraform help?

regards,
kay
0
How to download awscli docker image  (I try docker run awscli it ask password without that is it possible)

How to download mariaDB docker image  (I try docker run mariaDB it ask password without that is it possible)
0
I currently have 20 WordPress Sites with Bluehost.com, and my goal is to migrate OUT to another service.  I am looking for recommendations for another service and any HOWTO's that might make this transition easier. Here are some parameters I have with Blue Host which may cost me much more with another provider.

Currently with Blue Host:
- Annual cost LESS THAN $200/year, and last was $99
- Unlimited site hosting... Note I have 20 wordpress installs currently, no extra cost
--  mysql DB service
-- CPanel admin interface, okay to use something else
-- SSH access
-- "Unlimited Storage", I currently use ~ 2GB of file store, and less than 500MB of DB storage

_- I do have an AWS account I can use, if that's the most cost effective... thus this post... I am having trouble with the cost effective part. Please note the current cost I put above.
0
how to read the csv file which is in AWS s3 bucket

aws s3 cp command will copy the file but i need to validate before copy the file ? is that possible ?
0
Hi Experts,

     docker container is not picking the recent changes from the source code.     it makes me to build the docker image every time to see the latest changes on the source code.

Please find below the contents of the Dockerfile

FROM ubuntu:16.04

MAINTAINER *****

RUN apt-get update -y
RUN apt-get install -y software-properties-common python-software-properties curl
RUN add-apt-repository -y ppa:fkrull/deadsnakes

RUN apt-get update -y && apt-get install -y curl
RUN apt-get update -y && apt-get install -y \
	git \
	python3.6 \
	python3.6-dev \
	nginx \
	sqlite3 \
	nodejs \
	build-essential \
	libmagickwand-dev \
	cron \
	nginx

RUN rm -f /usr/bin/python3
RUN ln -s /usr/bin/python3.6 /usr/bin/python3
RUN curl https://bootstrap.pypa.io/get-pip.py | python3

WORKDIR /home/trove
COPY . .

COPY build/docker/uwsgi_params .
COPY build/docker/uwsgi.ini .
RUN pip3 install --no-cache-dir uwsgi
RUN pip3 install --no-cache-dir -r requirements.txt

COPY build/docker/start /usr/bin/
COPY build/docker/crontab /etc/cron.d/harvest-cron
RUN chmod 0644 /etc/cron.d/harvest-cron
RUN touch /var/log/harvest.log

RUN echo "daemon off;" >> /etc/nginx/nginx.conf
COPY build/docker/nginx-app.conf /etc/nginx/sites-available/default
COPY build/docker/start /usr/bin/
RUN mkdir /var/log/harvest/
RUN python3 manage.py collectstatic --noinput

WORKDIR /home/trove/
RUN chmod 755 /home/trove
RUN chown -R www-data:www-data /home/trove

EXPOSE 80
CMD ["start"]

Open in new window


please find below the contents of the crontab

SHELL=/bin/bash
* * * * * root ( source /tmp/environment.sh && /usr/bin/python3 /home/trove/run.py $(cat /tmp/method) ) >> /dev/null 2>/var/log/harvest/ts_errors.log

Open in new window

0
Python 3 Fundamentals
LVL 12
Python 3 Fundamentals

This course will teach participants about installing and configuring Python, syntax, importing, statements, types, strings, booleans, files, lists, tuples, comprehensions, functions, and classes.

What are all the package need to access docker to lambda


lambda will call s3 bucket .

I need automated script (that script will daily mid night will run)
0
how we can read s3 bucket files form docker container
what are the package needed and what is the command

how we can put data to maria DB form docker container
what are the package needed and what is the command
0
Hi Experts!

Could you point a good (didactic) material preferencialy that you know about AWS web service creation by using PHP?

Thanks in advance
0
How to find how many records present  in csv file using Java
The file will be present in S3 location . Is there any AWS services available for this ?
0
I have a client environment within AWS, that uses a Direct Connect solution to connect to an external resource.  I have now been asked to create a VPN connection to the environment for a new resource for the web solution.
We currently have the direct connection associated with a Virtual Private Gateway, which is attached to the VPC that the solution resides.
Having not had a massive amount of experience with this part of AWS I'm a little unsure how i can proceed - from reading I can only have 1 VPG attached to a VPC at any one time - so creating a second VPG and creating the VPN connection on that is not possible. but if i create a new VPN connection on the existing VPG, will this work and how will the routing for this work to decide what traffic goes were after i add a route to the VPG for VPN traffic?
0
Hi Experts,

   I got a server which runs applications with docker and aws, running from console(putty).  The command to run is as follows:-

docker run --name ts_pull ${ts_environment[@]}  -d  --restart always 1234656458.dkr.ecr.ap-southeast-2.amazonaws.com/harvest-ts:1.0.2 start pull

Open in new window


I can understand 1234656458.dkr.ecr.ap-southeast-2.amazonaws.com/harvest-ts:1.0.2 is from aws.  Can any tell me how this container application is pushed to aws?

From the documentation I found Dockerfile is available, from which the docker image is built.  I don't understand how to push this to aws and run with the docker.

Please throw some light over it.

with many thanks,

Bharath AK
0
Hi Experts,

I want to restore postgres database.

I had taken backup with pg_dump.  the command which I used to take backup is

pg_dump -U postgres -h 127.0.0.1 -p 5432 ts > ts.tar
password:

it created the file ts.tar

Steps I had tried to restore is

root@ip-10-252-14-11:/home/ubuntu/workarea/sourcecode/database_backup# pg_restore --host localhost --port 5432 --username "postgres" --dbname "ts" --role "ts" --no-password --verbose "./ts.tar"
pg_restore: [archiver] input file appears to be a text format dump. Please use psql.

root@ip-10-252-14-11:/home/ubuntu/workarea/sourcecode/database_backup# pg_restore --host localhost --port 5432 --username "postgres" --dbname "ts" --role "ts" --no-password < "./ts.tar"
pg_restore: [archiver] input file appears to be a text format dump. Please use psql.

root@ip-10-252-14-11:/home/ubuntu/workarea/sourcecode/database_backup# pg_restore --host 127.0.0.1 --port 5432 --username "postgres" --dbname "ts" --role "ts" --no-password < "./ts.tar"
pg_restore: [archiver] input file appears to be a text format dump. Please use psql.

root@ip-10-252-14-11:/home/ubuntu/workarea/sourcecode/database_backup# pg_restore --host 127.0.0.1 --port 5432 --username "postgres" --dbname "ts" --role "ts"  < "./ts.tar"
pg_restore: [archiver] input file appears to be a text format dump. Please use psql.

root@ip-10-252-14-11:/home/ubuntu/workarea/sourcecode/database_backup# pg_restore --host 127.0.0.1 --port 5432 --username "ts" --dbname "ts" 

Open in new window

0
Hi Experts,

   How to delete the existing elasticsearch cluster and how to create a new elasticsearch cluster?  Please throw some best practices.

With Many thanks,

Bharath AK
0
List of configurations that can be implemented that can properly secure  S3 buckets
0
Microsoft Azure 2017
LVL 12
Microsoft Azure 2017

Azure has a changed a lot since it was originally introduce by adding new services and features. Do you know everything you need to about Azure? This course will teach you about the Azure App Service, monitoring and application insights, DevOps, and Team Services.

We are allowing one of our Software Vendors to relay emails from their Cloud Application on Amazon AWS thru our Exchange Server.  The application is sending notifications to certain people within our organization.  The emails are coming from an internal email address I created so its coming from our domain.  It was working perfectly then the software vendor changed AWS servers but kept the same IP Address and now we are only getting a few of the emails?  We did not change anything on our end and I am puzzled as to why it is no longer working?  Anyone have any ideas?  I had setup anew SMTP connector for them to relay thru and have checked all of the settings.  They set me up with a test site from their Server so I could test as I was troubleshooting.  I have had a few of the test emails got hru randomly, but most fail wit this error message:

Database: CTixPROD

ErrorType: System.Net.Sockets.SocketException

MethodName: TryCatch ~ System.Net.Sockets.Socket.DoConnect()

ErrorMessage: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 206.124.223.12:25

StackTrace: at System.Net.Sockets.Socket.DoConnect(EndPoint endPointSnapshot, SocketAddress socketAddress) at System.Net.ServicePoint.ConnectSocketInternal(Boolean connectFailure, Socket s4, Socket s6, Socket& socket, IPAddress& address, ConnectSocketState state, IAsyncResult …
0
Is it possible through the CLI, Power Tools (or anything else) to list files stored in S3 by their storage type? Basically, I want to see a list of files from a bucket that are using Standard-IA as the storage type. There are too many nested prefixes in the bucket to go through each one and sort by the storage type column to find the few files I'm looking for.
0
i use aws-sdk for javascript to give user choice to enable/disable 2 factor auth for login. i have 2 issues: UI is capturing user phone and updates cognito phone_number attribute. (updateUserAttributes) First issue is with this stage, it updates the number but returns empty object instead of

{
    "CodeDeliveryDetailsList": [ 
    { 
        "AttributeName": "string",
        "DeliveryMedium": "string",
        "Destination": "string"
    }
    ]
}

Open in new window

Second, i am trying to send user a verification code with getAttributeVerificationCode with the following payload:

const params = { 
  AccessToken: auth.accessToken,    
  AttributeName: 'phone_number'
}

Open in new window

and i am getting "CustomMessage failed with error Cannot read property identity of undefined" error. Any ideas?

Thanks
0
Hi All,

I have these thousands of tag i need to apply to vms running in both azure and aws: below is an example of tag - values:

BusinessUnit: TestBusinessunit
Owner: KellyG
CostCentreCode: kellycostcentre
Name: KellyTestTagName
ApplicationID: KellyApplicationID
Functionality: functionalitytag
Environment: envronmenttag
Schedule: 10/10/2010
Monitoring: yes
Geography: Geographytag
ExternallyManaged: Managed by oup
Backups: Backed up to Azure RSV

the tags will have different values per resource, example owner:kelly, owner: Sandy,etc.

if tag already exists , we need a log it, etc.

whats the best way to approach this via powershell script. so far my idea is to store the values in csv then from csv produce into a hash table then create a function to apply the tags.

please help. just an overview of how to do this will be great.

reagards,
kelly
0
Tagging in Azure and AWS -

We have thousands of servers withing both the AWS and Azure Cloud providers.

We need to apply the following tags to all the resources as well as any new resources created in any of cloud providers.

BusinessUnit:      Identify business unit e.g. Finance, Marketing, Human Resources,            
Owner:      The email distribution name of the team,            
CostCentreCode:      Used to identify the cost centre code for cross charging,            
Name:      Used to identify the individual resource,            
ApplicationID:      Used to identify resources that are related to specific applications,            
Functionality:      Used to identify the purpose of the resource, i.e. web, message broker, DB,            
Environment:       To identify Production, PreProd, UAT, Dev, Test, Performance, Security etc,            
Schedule:       Identifies whether the server should be powered down at certain times,            
Monitoring:      Required if server is being monitored or not,            
Geography:      This should contain the Oxford University Press' geography the resource group is utilised by,            
ExternallyManaged:      3rd party support details such as HT2, CirrusHQ, Avallain, Cognizant,            
Backups:      Backup schedule and to where            

what is the best way to implement this ? do know anyone know a script i can utilise to deploy this in both environments?

Regards,
Kay
0
Pass-the-Hash Protection questions-

- Does Windows 10 Hello (local not Business) that is domain joined protect against pass the hash?[/list]
- If above is true, is it the same protection as Credential Guard?
- Since Credential Guard is not available for VM/EC2 on AWS, what are some alternatives?

Thanks
0

AWS

Amazon Web Services (AWS), is a collection of remote computing services, also called web services, that make up a cloud-computing platform  operated from 11 geographical regions across the world. The most central and well-known of these services include Amazon Elastic Compute Cloud, also known as "EC2", and Amazon Simple Storage Service, also known as "S3". Other services include Elastic MapReduce (EMR), Route 53 (a DNS web service),  provides a highly available and scalable Domain Name System (DNS) web service, Virtual Private Cloud (VPC), storage, database, deployment and application services.