Monday, November 18, 2013

Oracle 11gR2 RAC LoadBalancing and TAF

Oracle Database 10g introduced an automatic workload management facility, called services. A service represents the workload of applications with common attributes, performance thresholds, and priorities. A single service can represent an application, multiple applications or a subset of a single application. A single service can be associated with one or more instances of an Oracle RAC database, and a single instance can support multiple services. Services provide the following benefits:
A single entity for managing applications that compete for the same resources
Allow each workload to be managed as a single unit
Hide the complexity of the cluster from the client
To manage workloads, you can define services that you assign to a particular application or to a subset of an application's operations. You can also use services to manage the workload for different types of work. For example, online users can use one service while batch processing can use a different service and reporting can use yet another service type.
Traditionally an Oracle database provided a single service and all users connected to the same service. A database will always have this default database service that is the database name. This service cannot be modified and will always allow you to connect to the database.
Note: Do not use the default database service for application workloads. Create at least one service as described in "Creating Services".
When a user or application connects to a database, Oracle recommends that you use a service for the connection.Oracle Database automatically creates one database service when the database is created. For many installations, this may be all you need. For more flexibility in the management of the workload using the database, Oracle Database enables you to create multiple services and specify which database instances offer the services.

srvctl add service Syntax and Options
Oracle Real Application Clusters Administration and Deployment Guide 11g Release 2 (11.2)
  1. [oracle@node1 ~]$ srvctl add service -h  
  2.   
  3. Adds a service configuration to the Oracle Clusterware.  
  4.   
  5. Usage: srvctl add service -d <db_unique_name> -s <service_name> {-r "<preferred_list>" [-a "<available_list>"] [-P {BASIC | NONE | PRECONNECT}] | -g <pool_name> [-c {UNIFORM | SINGLETON}] } [-k   <net_num>] [-l [PRIMARY][,PHYSICAL_STANDBY][,LOGICAL_STANDBY][,SNAPSHOT_STANDBY]] [-y {AUTOMATIC | MANUAL}] [-q {TRUE|FALSE}] [-x {TRUE|FALSE}] [-j {SHORT|LONG}] [-B {NONE|SERVICE_TIME|THROUGHPUT}] [-e {NONE|SESSION|SELECT}] [-m {NONE|BASIC}] [-z <failover_retries>] [-w <failover_delay>] [-t <edition>] [-f]  
  6.     -d <db_unique_name>      Unique name for the database  
  7.     -s <service>             Service name  
  8.     -r "<preferred_list>"    Comma separated list of preferred instances  
  9.     -a "<available_list>"    Comma separated list of available instances  
  10.     -g <pool_name>           Server pool name  
  11.     -c {UNIFORM | SINGLETON} Service runs on every active server in the server pool hosting this service (UNIFORM) or just one server (SINGLETON)  
  12.     -k <net_num>             network number (default number is 1)  
  13.     -P {NONE | BASIC | PRECONNECT}        TAF policy specification  
  14.     -l <role>                Role of the service (primary, physical_standby, logical_standby, snapshot_standby)  
  15.     -y <policy>              Management policy for the service (AUTOMATIC or MANUAL)  
  16.     -e <Failover type>       Failover type (NONE, SESSION, or SELECT)  
  17.     -m <Failover method>     Failover method (NONE or BASIC)  
  18.     -w <integer>             Failover delay  
  19.     -z <integer>             Failover retries  
  20.     -t <edition>             Edition (or "" for empty edition value)  
  21.     -j <clb_goal>  Connection Load Balancing Goal (SHORT or LONG). Default is LONG.  
  22.     -B <Runtime Load Balancing Goal>     Runtime Load Balancing Goal (SERVICE_TIME, THROUGHPUT, or NONE)  
  23.     -x <Distributed Transaction Processing>  Distributed Transaction Processing (TRUE or FALSE)  
  24.     -q <AQ HA notifications> AQ HA notifications (TRUE or FALSE)  
  25. Usage: srvctl add service -d <db_unique_name> -s <service_name> -u {-r "<new_pref_inst>" | -a "<new_avail_inst>"} [-f]  
  26.     -d <db_unique_name>      Unique name for the database  
  27.     -s <service>             Service name  
  28.     -u                       Add a new instance to service configuration  
  29.     -r <new_pref_inst>       Name of new preferred instance  
  30.     -a <new_avail_inst>      Name of new available instance  
  31.     -f                       Force the add operation even though a listener is not configured for a network  
  32.     -h                       Print usage  


Use this example syntax to add the gl.example.com service to the my_rac database with AQ HA notifications enabled, a failover method of BASIC, a Connection Load Balancing Goal of LONG, a failover type of SELECT, and 180 failover retries with a delay of 5:
srvctl add service -d my_rac -s gl.example.com -q TRUE -m BASIC -e SELECT -z 180 -w 5 -j LONG

Use this example syntax to add a named service to a database with preferred instances in list one and available instances in list two, using preconnect failover for the available instances:
srvctl add service -d crm -s sales -r crm01,crm02 -a crm03 -P PRECONNECT



Add services to support the load balancing and TAF
Add a name for "ZWC" service, instance node1 as the first choice for instance node, instance node2 as standby node, TAF strategy use "PRECONNECT" preliminary connection, fault switching type to "SELECT" enable  transaction support, switch delay set to 0, use the following order:
  1. [oracle@node1 ~]$ srvctl add service -d zhongwc -s ZWC -r 'zhongwc1' -a 'zhongwc2' -P PRECONNECT -e SELECT -x TRUE -w 0  
  2. [oracle@node1 ~]$   
  3. [oracle@node1 ~]$   
  4. [oracle@node1 ~]$ srvctl  config service -d zhongwc -s ZWC -a  
  5. Warning:-a option has been deprecated and will be ignored.  
  6. Service name: ZWC  
  7. Service is enabled  
  8. Server pool: zhongwc_ZWC  
  9. Cardinality: 1  
  10. Disconnect: false  
  11. Service role: PRIMARY  
  12. Management policy: AUTOMATIC  
  13. DTP transaction: true  
  14. AQ HA notifications: false  
  15. Failover type: SELECT  
  16. Failover method: NONE  
  17. TAF failover retries: 0  
  18. TAF failover delay: 0  
  19. Connection Load Balancing Goal: LONG  
  20. Runtime Load Balancing Goal: NONE  
  21. TAF policy specification: PRECONNECT  
  22. Edition:   
  23. Preferred instances: zhongwc1  
  24. Available instances: zhongwc2  
  25. [oracle@node1 ~]$   
  1. [oracle@node1 ~]$ srvctl modify service -d zhongwc -s ZWC -z 180 -w 5 -m BASIC  
  2. [oracle@node1 ~]$ srvctl modify service -d zhongwc -s ZWC -B SERVICE_TIME  
  3. [oracle@node1 ~]$ srvctl modify service -d zhongwc -s ZWC -q TRUE  
  4. [oracle@node1 ~]$ srvctl modify service -d zhongwc -s ZWC -j SHORT  
  5. [oracle@node1 ~]$   
  6. [oracle@node1 ~]$   
  7. [oracle@node1 ~]$ srvctl  config service -d zhongwc -s ZWC  
  8. Service name: ZWC  
  9. Service is enabled  
  10. Server pool: zhongwc_ZWC  
  11. Cardinality: 1  
  12. Disconnect: false  
  13. Service role: PRIMARY  
  14. Management policy: AUTOMATIC  
  15. DTP transaction: true  
  16. AQ HA notifications: true  
  17. Failover type: SELECT  
  18. Failover method: BASIC  
  19. TAF failover retries: 180  
  20. TAF failover delay: 5  
  21. Connection Load Balancing Goal: SHORT  
  22. Runtime Load Balancing Goal: SERVICE_TIME  
  23. TAF policy specification: PRECONNECT  
  24. Edition:   
  25. Preferred instances: zhongwc1  
  26. Available instances: zhongwc2  

Start "ZWC" service
  1. [oracle@node1 ~]$ srvctl start service -d zhongwc -s ZWC  
  2. [oracle@node1 ~]$ su - grid -c "crsctl stat res -t"  
  3. Password:   
  4. --------------------------------------------------------------------------------  
  5. NAME           TARGET  STATE        SERVER                   STATE_DETAILS         
  6. --------------------------------------------------------------------------------  
  7. Local Resources  
  8. --------------------------------------------------------------------------------  
  9. ora.CRS.dg  
  10.                ONLINE  ONLINE       node1                                          
  11.                ONLINE  ONLINE       node2                                          
  12. ora.DATADG.dg  
  13.                ONLINE  ONLINE       node1                                          
  14.                ONLINE  ONLINE       node2                                          
  15. ora.FRADG.dg  
  16.                ONLINE  ONLINE       node1                                          
  17.                ONLINE  ONLINE       node2                                          
  18. ora.LISTENER.lsnr  
  19.                ONLINE  ONLINE       node1                                          
  20.                ONLINE  ONLINE       node2                                          
  21. ora.asm  
  22.                ONLINE  ONLINE       node1                    Started               
  23.                ONLINE  ONLINE       node2                    Started               
  24. ora.gsd  
  25.                OFFLINE OFFLINE      node1                                          
  26.                OFFLINE OFFLINE      node2                                          
  27. ora.net1.network  
  28.                ONLINE  ONLINE       node1                                          
  29.                ONLINE  ONLINE       node2                                          
  30. ora.ons  
  31.                ONLINE  ONLINE       node1                                          
  32.                ONLINE  ONLINE       node2                                          
  33. --------------------------------------------------------------------------------  
  34. Cluster Resources  
  35. --------------------------------------------------------------------------------  
  36. ora.LISTENER_SCAN1.lsnr  
  37.       1        ONLINE  ONLINE       node2                                          
  38. ora.cvu  
  39.       1        ONLINE  ONLINE       node1                                          
  40. ora.node1.vip  
  41.       1        ONLINE  ONLINE       node1                                          
  42. ora.node2.vip  
  43.       1        ONLINE  ONLINE       node2                                          
  44. ora.oc4j  
  45.       1        ONLINE  ONLINE       node1                                          
  46. ora.scan1.vip  
  47.       1        ONLINE  ONLINE       node2                                          
  48. ora.zhongwc.db  
  49.       1        ONLINE  ONLINE       node1                    Open                  
  50.       2        ONLINE  ONLINE       node2                    Open                  
  51. ora.zhongwc.zwc.svc  
  52.       1        ONLINE  ONLINE       node1                                          
  53. ora.zhongwc.zwc_preconnect.svc  
  54.       1        ONLINE  ONLINE       node2                     
  1. [oracle@node1 ~]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Sun Jan 6 16:12:08 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7.   
  8. Connected to:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> show parameter service_name  
  14.   
  15. NAME                     TYPE    VALUE  
  16. ------------------------------------ ----------- ------------------------------  
  17. service_names                string  ZWC  
  1. [oracle@node2 ~]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Sun Jan 6 16:12:33 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7.   
  8. Connected to:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> show parameter service_name  
  14.   
  15. NAME                     TYPE    VALUE  
  16. ------------------------------------ ----------- ------------------------------  
  17. service_names                string  zwc_preconnect  

node1,node2 tnsnames
  1. [oracle@node2 ~]$ cat $ORACLE_HOME/network/admin/tnsnames.ora  
  2. # tnsnames.ora Network Configuration File: /u01/app/oracle/product/11.2.0/dbhome_1/network/admin/tnsnames.ora  
  3. # Generated by Oracle configuration tools.  
  4.   
  5. ZHONGWC =  
  6.   (DESCRIPTION =  
  7.     (ADDRESS = (PROTOCOL = TCP)(HOST = node-cluster-scan)(PORT = 1521))  
  8.     (CONNECT_DATA =  
  9.       (SERVER = DEDICATED)  
  10.       (SERVICE_NAME = zhongwc)  
  11.     )  
  12.   )  
  13.   
  14. ZWC = (DESCRIPTION =  
  15.     (ADDRESS = (PROTOCOL = TCP)(HOST = node-cluster-scan)(PORT = 1521))  
  16.     (LOAD_BALANCE = YES)  
  17.     (CONNECT_DATA =  
  18.         (SERVER = DEDICATED)  
  19.         (SERVICE_NAME = ZWC)  
  20.         (FAILOVER_MODE =  
  21.             (BACKUP = ZWC_PRECONNECT)  
  22.             (TYPE = SELECT)  
  23.             (METHOD = PRECONNECT)  
  24.             (RETRIES = 180)  
  25.             (DELAY = 5)  
  26.         )  
  27.     )  
  28. )  
  29.   
  30. ZWC_PRECONNECT = (DESCRIPTION =  
  31.     (ADDRESS = (PROTOCOL = TCP)(HOST = node-cluster-scan)(PORT = 1521))  
  32.     (LOAD_BALANCE = YES)  
  33.     (CONNECT_DATA =  
  34.         (SERVER = DEDICATED)  
  35.         (SERVICE_NAME = ZWC_PRECONNECT)  
  36.         (FAILOVER_MODE =  
  37.             (TYPE = SELECT)  
  38.             (METHOD = BASIC)  
  39.             (RETRIES = 180)  
  40.             (DELAY = 5)  
  41.         )  
  42.     )  
  43. )  

parameter interpretation

test
node1
  1. [oracle@node1 dbhome_1]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Mon Jan 7 09:23:31 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7.   
  8. Connected to:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL>   
  14. SQL>   
  15. SQL>   
  16. SQL> show parameter service_names  
  17.   
  18. NAME                     TYPE    VALUE  
  19. ------------------------------------ ----------- ------------------------------  
  20. service_names                string  ZWC  

node2
  1. [oracle@node2 ~]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Mon Jan 7 09:23:38 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7.   
  8. Connected to:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> show parameter service_na  
  14.   
  15. NAME                     TYPE    VALUE  
  16. ------------------------------------ ----------- ------------------------------  
  17. service_names                string  zwc_preconnect  

client
  1. C:\>sqlplus scott/tiger@node-cluster-scan/zwc  
  2.   
  3. SQL*Plus: Release 10.2.0.1.0 - Production on 星期一 1月 7 09:25:12 2013  
  4.   
  5. Copyright (c) 1982, 2005, Oracle.  All rights reserved.  
  6.   
  7.   
  8. 连接到:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> alter session set nls_date_format='yyyy-mm-dd hh24:mi:ss';  
  14.   
  15. 会话已更改。  
  16.   
  17. SQL> set line 300  
  18. SQL> col machine format a22  
  19. SQL> SELECT MACHINE, FAILOVER_TYPE, FAILOVER_METHOD, FAILED_OVER, COUNT(*) FROM V$SESSION GROUP BY MACHINE, FAILOVER_TYPE, FAILOVER_METHOD, FAILED_OVER;  
  20.   
  21. MACHINE                FAILOVER_TYPE FAILOVER_M FAI   COUNT(*)  
  22. ---------------------- ------------- ---------- --- ----------  
  23. DINA\PC-201204200916   SELECT        BASIC      NO           1  
  24. node1                  NONE          NONE       NO          43  


abort node1 instance
  1. SQL> shutdown abort  
  2. ORACLE instance shut down.  
  1. [grid@node1 ~]$ crsctl stat res -t  
  2. --------------------------------------------------------------------------------  
  3. NAME           TARGET  STATE        SERVER                   STATE_DETAILS         
  4. --------------------------------------------------------------------------------  
  5. Local Resources  
  6. --------------------------------------------------------------------------------  
  7. ora.CRS.dg  
  8.                ONLINE  ONLINE       node1                                          
  9.                ONLINE  ONLINE       node2                                          
  10. ora.DATADG.dg  
  11.                ONLINE  ONLINE       node1                                          
  12.                ONLINE  ONLINE       node2                                          
  13. ora.FRADG.dg  
  14.                ONLINE  ONLINE       node1                                          
  15.                ONLINE  ONLINE       node2                                          
  16. ora.LISTENER.lsnr  
  17.                ONLINE  ONLINE       node1                                          
  18.                ONLINE  ONLINE       node2                                          
  19. ora.asm  
  20.                ONLINE  ONLINE       node1                    Started               
  21.                ONLINE  ONLINE       node2                    Started               
  22. ora.gsd  
  23.                OFFLINE OFFLINE      node1                                          
  24.                OFFLINE OFFLINE      node2                                          
  25. ora.net1.network  
  26.                ONLINE  ONLINE       node1                                          
  27.                ONLINE  ONLINE       node2                                          
  28. ora.ons  
  29.                ONLINE  ONLINE       node1                                          
  30.                ONLINE  ONLINE       node2                                          
  31. --------------------------------------------------------------------------------  
  32. Cluster Resources  
  33. --------------------------------------------------------------------------------  
  34. ora.LISTENER_SCAN1.lsnr  
  35.       1        ONLINE  ONLINE       node2                                          
  36. ora.cvu  
  37.       1        ONLINE  ONLINE       node1                                          
  38. ora.node1.vip  
  39.       1        ONLINE  ONLINE       node1                                          
  40. ora.node2.vip  
  41.       1        ONLINE  ONLINE       node2                                          
  42. ora.oc4j  
  43.       1        ONLINE  ONLINE       node1                                          
  44. ora.scan1.vip  
  45.       1        ONLINE  ONLINE       node2                                          
  46. ora.zhongwc.db  
  47.       1        OFFLINE OFFLINE                               Instance Shutdown     
  48.       2        ONLINE  ONLINE       node2                    Open                  
  49. ora.zhongwc.zwc.svc  
  50.       1        ONLINE  ONLINE       node2                                          
  51. ora.zhongwc.zwc_preconnect.svc  
  52.       1        ONLINE  OFFLINE                                   


client
  1. C:\>sqlplus scott/tiger@node-cluster-scan/zwc  
  2.   
  3. SQL*Plus: Release 10.2.0.1.0 - Production on 星期一 1月 7 09:25:12 2013  
  4.   
  5. Copyright (c) 1982, 2005, Oracle.  All rights reserved.  
  6.   
  7.   
  8.   
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> alter session set nls_date_format='yyyy-mm-dd hh24:mi:ss';  
  14.   
  15.   
  16.   
  17. SQL> set line 300  
  18. SQL> col machine format a22  
  19. SQL> SELECT MACHINE, FAILOVER_TYPE, FAILOVER_METHOD, FAILED_OVER, COUNT(*) FROM V$SESSION GROUP BY MACHINE, FAILOVER_TYPE, FAILOVER_METHOD, FAILED_OVER;  
  20.   
  21. MACHINE                FAILOVER_TYPE FAILOVER_M FAI   COUNT(*)  
  22. ---------------------- ------------- ---------- --- ----------  
  23. DINA\PC-201204200916   SELECT        BASIC      NO           1  
  24. node1                  NONE          NONE       NO          43  
  25.   
  26. SQL> SELECT MACHINE, FAILOVER_TYPE, FAILOVER_METHOD, FAILED_OVER, COUNT(*) FROM V$SESSION GROUP BY MACHINE, FAILOVER_TYPE, FAILOVER_METHOD, FAILED_OVER;  
  27.   
  28. MACHINE                FAILOVER_TYPE FAILOVER_M FAI   COUNT(*)  
  29. ---------------------- ------------- ---------- --- ----------  
  30. node2                  NONE          NONE       NO          51  
  31. DINA\PC-201204200916   SELECT        BASIC      YES          1  
  32.   
  33. SQL>  

node2
  1. [oracle@node2 ~]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Mon Jan 7 09:23:38 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7.   
  8. Connected to:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> show parameter service_na  
  14.   
  15. NAME                     TYPE    VALUE  
  16. ------------------------------------ ----------- ------------------------------  
  17. service_names                string  zwc_preconnect  
  18. SQL>   
  19. SQL>   
  20. SQL> show parameter service_na  
  21.   
  22. NAME                     TYPE    VALUE  
  23. ------------------------------------ ----------- ------------------------------  
  24. service_names                string  ZWC  


start node1 instance and the "ZWC" service reset to the node1
  1. [oracle@node1 ~]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Mon Jan 7 09:38:58 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7. Connected to an idle instance.  
  8.   
  9. SQL> startup  
  10. ORACLE instance started.  
  11.   
  12. Total System Global Area  839282688 bytes  
  13. Fixed Size          2233000 bytes  
  14. Variable Size         624954712 bytes  
  15. Database Buffers      209715200 bytes  
  16. Redo Buffers            2379776 bytes  
  17. Database mounted.  
  18. Database opened.  
  19. SQL> !srvctl relocate service -d zhongwc -s ZWC -i zhongwc2 -t zhongwc1  
  20.   
  21. SQL> show parameter service_names  
  22.   
  23. NAME                     TYPE    VALUE  
  24. ------------------------------------ ----------- ------------------------------  
  25. service_names                string  ZWC  

node2
  1. [oracle@node2 ~]$ sqlplus / as sysdba  
  2.   
  3. SQL*Plus: Release 11.2.0.3.0 Production on Mon Jan 7 09:23:38 2013  
  4.   
  5. Copyright (c) 1982, 2011, Oracle.  All rights reserved.  
  6.   
  7.   
  8. Connected to:  
  9. Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production  
  10. With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,  
  11. Data Mining and Real Application Testing options  
  12.   
  13. SQL> show parameter service_na  
  14.   
  15. NAME                     TYPE    VALUE  
  16. ------------------------------------ ----------- ------------------------------  
  17. service_names                string  zwc_preconnect  
  18. SQL>   
  19. SQL>   
  20. SQL> show parameter service_na  
  21.   
  22. NAME                     TYPE    VALUE  
  23. ------------------------------------ ----------- ------------------------------  
  24. service_names                string  ZWC  
  25. SQL> show parameter service_na  
  26.   
  27. NAME                     TYPE    VALUE  
  28. ------------------------------------ ----------- ------------------------------  
  29. service_names                string  zwc_preconnect  
Posted by at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)