===================================================================================

==================================

===================================================================================
====================================
du -sh /home/out-nema-a(disk usage)

hdfs dfs -cp /data/usl/da19/ndl_eks_subj_org/snp/subj_orgidfn

/data/usl/da19/ndl_eks_subj_org/snp/subj_orgidfn_day0_bkp

hdfs dfs -cp /data/usl/da19/ndl_eks_subj_org/snp/subj_orgidfn_day0_bkp/*

/data/usl/da19/ndl_eks_subj_org/snp/subj_orgidfn
===================================================================================
================================
PROD
===================================================================================
================================
air -branch B0025 tag create pld.O.USL-542.20211126151500.USL-13153 -file tag.txt -
exact(object tag creation)

cat /abinitio/data-mount/data/serial/sberbank/mapping/eks/lookup/eks/delta/
snap_hist_ctl_loading_z_client.lkp
cat /abinitio/data-mount/data/serial/sberbank/mapping/eks/lookup/eks/delta/
snap_hist_ctl_loading_z_cl_priv.lkp

Tracking file:
/abinitio/data-mount/data/admin/sberbank/mapping/eks/tracking/eks/
*_ess_pre_eks_subj_ind_mppng_2021-11-29-*

m_mv /data/envs/data/da19/data/serial/MDW_PUB/lookup/1468672455
/data/envs/data/da19/data/serial/MDW_PUB/lookup/1468672455_bkp(permission denied
issue on service)

m_mv /data/envs/data/da19/data/serial/MDW_PUB/lookup/1347201122
/data/envs/data/da19/data/serial/MDW_PUB/lookup/1347201122_bkp

===================================================================================
======================================================================
ST
===================================================================================
======================================================================
http://tklis-fauna0230.st.df.sbrf.ru:8080/cc/spa/index.jsp#/groupBy=type/
sortBy=Worst%20first/hostNames=false/problemsOnly=false (CC link)

sudo -i -u u_stsklabi_s_devops air project export

/Projects/sberbank/mapping/MDW_PUB -basedir /sandboxes/sberbank/mapping/MDW_PUB -
config development.pset (dotools issue)

===================================================================================
=======================================================================
Beeline commands
===================================================================================
=======================================================================

beeline -u ' jdbc:hive2://hive.cloud.dev.df.sbrf.ru:10000/default;principal=hive/

[email protected]'

beeline -u 'jdbc:hive2://tkli-od0008.dev.df.sbrf.ru:10000/default;principal=hive/
[email protected]'

beeline -u 'jdbc:hive2://tkli-od0010.dev.df.sbrf.ru:10000/default;principal=hive/
[email protected]'
===================================================================================
========================================================================
R1 backups
===================================================================================
=========================================================================
/data/envs/data/da11/data/mfs/mfs_dnlocal_4way/R1/USL-6188/idl_agr_cred_c
/data/envs/data/da11/data/mfs/mfs_dnlocal_4way/R1/USL-6188/idl_gl
/data/usl/da11/idl_agr_cred_c/6188_bkp/snp/day0/ (day0 backup od agr_cred_C on
main)
/data/usl/da11/idl_agr_cred_c/6188_bkp/snp/day1/ (day1 backup)
/data/usl/ta11/idl_rdm_gl/_bkp/snp/day0/(bkp_idl_rdm_gl on ta11)
/data/core/internal/da11/R1/USL-5229
/data/usl/da11/idl_gl/snp_bkp_day0_idl_gl(day0 bkp idl_gl da11)
m_partition dml sourcefile targetfile key(optional)
/data/usl/da11/idl_gl/snp_day1_idl_gl(day1 bkp)
/data/usl/ta11/idl_rdm_gl/snp_idl_rdm_gl_day0
/data/usl/da11/idl_rdm_gl/snp_idl_rdm_gl_06_10
/data/usl/ta11/idl_gl/snp_day0_new

/data/core/internal/da11/R1/idl_gl_combine/day0/ndl_nath_gl/acct_h

hdfs:/data/usl/ndl_cod_agr/idl_gl_acct_h_combined/snp/day1/acct_h
/data/usl/ta11/idl_gl/snp_day0_new_bkp_14_10
hdfs dfs -cp hdfs:///data/core/internal/da11/R01/idl_gl/usl_da21_ndl_ekp_gl_snp/
day1_new/acct_bal /data/usl/ta11/ndl_ekp_gl/snp/acct_bal
hdfs dfs -cp
/data/core/internal/da11/R01/idl_gl/usl_ndl_g2bk_gl_snp/day1_new/acct_bal
/data/usl/ta11/ndl_ekp_gl/snp/acct_bal

history|grep export
===================================================================================
==========================================================================
Sudo commands for cc
execution
===================================================================================
==========================================================================
sudo -i -u u_abi_s_<env>_adm touch
/data/envs/data/<env>/data/serial/sberbank/mapping/eks/main/eks/deploy_controlcente
r/<env>_USL/00001.ksh

sudo -i -u u_abi_s_<env>_adm touch

/data/envs/data/<env>/data/serial/sberbank/mapping/eks/main/eks/deploy_controlcente
r/<env>_USL/00002.ksh

/data/envs/sandboxes/ta23/sberbank/mapping/idl/idl/run

1. export AB_OPS_CONSOLE_URL=https://mimi16.dev.df.sbrf.ru:8227/controlcenter
export AB_OPS_WSS_USERNAME=<user>
export AB_OPS_WSS_PASSWORD= <password>
2. sudo -i -u u_abi_s_ta11_adm
/data/envs/sandboxes/ta11/sberbank/interfaces/ESS_PUB/bin/run_cc_job_list.ksh
/data/envs/sandboxes/ta11
/data/envs/sandboxes/ta11/sberbank/mapping/idl/idl/bin/deploy/usl_idl_rdm_gl.prod.d
ay0.1.conf.txt
sudo -i -u u_abi_s_ta19_adm
/data/envs/sandboxes/ta19/sberbank/interfaces/ESS_PUB/bin/run_cc_job_list.ksh
/data/envs/sandboxes/ta19
/data/envs/sandboxes/ta19/sberbank/mapping/eks/mp/ess_eks_pre_agr_acct_cred_colt_cl
o.mp SUBMITTED

sudo -i -u u_abi_s_ta11_adm
/data/envs/sandboxes/ta11/sberbank/interfaces/ESS_PUB/bin/run_cc_job_list.ksh
/data/envs/sandboxes/ta11
/data/envs/sandboxes/ta11/sberbank/mapping/idl/idl/pset/o_usl_idl_gl_load_acct_h.ps
et

===================================================================================
==========================================================================
INTEGRATION COMMAND
===================================================================================
==========================================================================
air -branch main project import /Projects/sberbank/mapping/idl/idl -basedir
/home/out-nema-a/da11/Projects/sberbank/mapping/idl/idl -files
controlcenter/USL/application/idl_agr_trade_c-application.xml -files
controlcenter/USL/application/idl_benchmarks-application.xml -files
controlcenter/USL/calendar/idl_agr_trade_c_caldr-calendar.xml -files
controlcenter/USL/calendar/idl_benchmarks_caldr-calendar.xml -files
controlcenter/USL/sched/idl_agr_cred_c_sched.sched -files
controlcenter/USL/sched/idl_agr_trade_c_sched.sched -files
controlcenter/USL/sched/idl_benchmarks_sched.sched -files
controlcenter/USL/sched/idl_gl_sched.sched -files
controlcenter/USL/pre_migration.ccd -files pset/d_usl_idl_agr_cred_c.pset -files
pset/d_usl_idl_agr_trade_c.pset -files pset/d_usl_idl_benchmarks.pset -files
pset/o_usl_idl_agr_cred_c.pset -files pset/o_usl_idl_agr_trade_c.pset -files
pset/o_usl_idl_benchmarks.pset -comment "IDL Integration for USL-6188"

===================================================================================
==========================================================================
AIR COMMANDS
===================================================================================
==========================================================================
air sandbox integrate /home/out-nema-a/Projects/sberbank/mapping/idl/idl -source-
branch team_cib -base-branch main -source-version
USL.R009.21.R009.7.model.7.6.0.idl.1.0.0.55584.USL-542.team_cib.20210825082943 -
base-version idl.G.USL-86.20210618171600.USL-4031.USL-86.20210618171848 -no-
lock{integration with no lock}

air sandbox integrate /home/out-nema-a/da11/Projects/sberbank/mapping/idl/idl -

source-branch team_cib -base-branch main -source-version
USL.R009.21.R009.7.model.7.6.0.idl.1.0.0.55584.USL-542.team_cib.20210825082943 -
base-version idl.G.USL-86.20210618171600.USL-4031.USL-86.20210618171848 -dry-
run{integration with lock}

air sandbox integrate /home/out-nema-a/da11/Projects/sberbank/mapping/idl/idl -

source-branch team_cib -base-branch main -source-version
USL.R009.21.R009.7.model.7.6.0.idl.1.0.0.56471.USL-542.team_cib.20210901165909 -
base-version idl.G.USL-86.20210618171600.USL-4031.USL-86.20210618171848 -files
plan/usl_idl_rdm_gl.plan

air sandbox integrate /home/bhosale-s/main/sberbank/mapping/idl/idl -source-branch

team_rb -source-version USL.R009.7.R009.7.model.7.6.0.idl.1.0.0.55406.USL-
369.team_rb.20210824115704 -base-branch main -base-version idl.G.USL-
86.20210618171600.USL-4031.USL-86.20210618171848 -files
plan/usl_idl_subj_ind.plan(for specific object)

air sandbox integrate /home/out-nema-a/da11/Projects/sberbank/interface/idl_pub -

source-branch team_cib -base-branch main -source-version
USL.R009.21.IDL_PUB.1.1.8.55497.USL-542.team_cib.20210824152027 -base-version
USL.R009.7.model.7.6.0.idl.1.0.0.43133.USL-369.B0014.20210616073342

air -branch team_cib versions /Projects/sberbank/mapping/idl/idl (base tag)

air -branch main project import /Projects/sberbank/mapping/ekp -basedir /home/out-

thombre-p/sandboxes/main/sberbank/mapping/ekp/ -files
bin/schedule/ndl_ekp_agr_approve.csv -files bin/schedule/ndl_ekp_gl_approve.csv -
comment "EKP Integration USL-8775 and USL-6274"

air project export /Projects/sberbank/mapping/pld -basedir

/home/out-nema-a/da19/Projects/sberbank/mapping/ACQUIRED_DATASET_PUB -common
/Projects /data/envs/sandboxes/da19(checkout)

air lock show -user out-nema-a

air -branch main tag object-versions USL.R009.21.mdw_generated.1.0.0.52735.USL-
542.B0025.20210806122606(tag version )

air -branch main lock release -project /Projects/sberbank/mapping/mdw_generated/

(if we need to remove whole lock)

air tag combine -create mdw_generated.G.USL-85.20210426104301.USL-1181.USL-

85.20210420091658 -latest mdw_generated.G.USL-85.20210420082618.USL-1181.USL-
85.20210420091658 mdw_generated.O.USL-49.20210426094106.USL-9439

air -branch B0025 project export /Projects/sberbank/mapping/idl -basedir /home/out-

nema-a/da19/Projects/sberbank/mapping/idl -common /Projects
/data/envs/sandboxes/da19 (checkout with branch name)

air -branch b0025 lock break

air -branch B0025 tag object versions USL.R009.21.mdw_generated.1.0.0.65386.USL-

542.B0025.20211215135257 (for tag version)

air -branch B0025 object versions

/Projects/sberbank/mapping/mdw_generated/xfr/loads/ab_ess_logical_subj_h/
add_inserts_partition_keys.xfr

===================================================================================
===================================================================================
=
LINK
===================================================================================
===================================================================================
=
https://confluence.ca.sbrf.ru/pages/viewpage.action?
spaceKey=ESS&title=Release+R009.22 (Data Model)

https://confluence.ca.sbrf.ru/display/VDBT/Development+Artifacts+R1(object list)

https://confluence.ca.sbrf.ru/display/VDBT/R1+ST+Artifacts (st artifacts)

netstat -e | grep 41550>(service port)

sudo -i -u u_abi_s_usl_ta19 air sandbox run

/data/envs/sandboxes/ta19/sberbank/mapping/mdw_services/mp/request_rpc.mp -
IN_KEY_ID 1249097346 -PAYLOAD TERMINATE
===================================================================================
========================================================================
Convert MFS to serial and Serial
to mfs
===================================================================================
========================================================================
1. Algo for convert [serial file] to [mfs file] is showing in below sample –

Pseudocode :
m_partition <source_serial_file_path>
<target_mfs_file_path> <required_target_dml_path>
Example:
m_partition
/data/envs/data/da11/data/serial/R1/USL-5095/idl_rdm_gl/ndl_cod_gl__crncy/
ab_ess_logical_crncy.20210825.dat
/data/envs/data/da11/data/mfs/mfs_dnlocal_4way/R1/USL-
5095/idl_rdm_gl/ndl_cod_gl__crncy/ab_ess_logical_crncy.20210825.pre_load.dat
/data/envs/sandboxes/da11/sberbank/mapping/MDW_PUB/dml/meta_physical/
ab_ess_logical/crncy.dml

2. Algo for convert [mfs file] to [serial file] is showing in below sample –

Pseudocode :
m_cat <source_mfs_file_path> >>
<target_serial_file_path>
Example:
m_cat
/data/envs/data/da11/data/mfs/mfs_dnlocal_4way/R1/USL-5095/idl_rdm_gl/
ndl_cod_gl__crncy/ab_ess_logical_crncy.20210825.pre_load.dat >>
/data/envs/data/da11/data/serial/R1/USL-5095/idl_rdm_gl/ndl_cod_gl__crncy/
ab_ess_logical_crncy.20210825.dat

Please find below script to find and delete old files in unix environment.
Server : mimi16.dev.df.sbrf.ru
/ tmp/scripts/find_user_created_files.ksh

Follow below steps to run the script.

1. Run script without arguments[It will delete files from default locations with
retention period 10 ]
ksh find_user_created_files.ksh

default locations.
/data/mfs
/data/admin
/data/audit
/data/serial
/data/envs/data
hdfs:/

2. Run script with arguments.

ksh find_user_created_files.ksh <file_path> <retention period>
cat input_file.dat
hdfs:/data/usl/ndl/eks/
/data/envs/data/da21

Please take a not if you are specifying HDFS directory then it should be prefixed
with hdfs:

===================================================================================
================================================================================
===================================================================================
=======================
PLD_BKPS
===================================================================================
========================
13010 /data/usl/da19/ndl_p_pld/snp/subj_h_bkp_day0(target)

===================================================================================
=========================