You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-04-01 - 16:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron

x86 Intel Core i7 7828EQ @3000 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of shadow in rack #9, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Sat Apr 01, 2023 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134291630,41ptp4l0-21swapper/007:07:480
134291620,43ptp4l0-21swapper/107:07:451
2465625144,2sleep20-21swapper/207:06:572
2473125046,2sleep30-21swapper/307:07:543
134291310,0ptp4l0-21swapper/012:35:220
134291280,0ptp4l0-21swapper/011:50:240
134291220,0ptp4l0-21swapper/107:15:301
134291210,0ptp4l0-21swapper/010:20:340
134291170,1ptp4l1511-21apt-get10:45:020
134291170,0ptp4l0-21swapper/111:10:231
134291170,0ptp4l0-21swapper/009:35:230
134291170,0ptp4l0-21swapper/007:55:240
134291160,1ptp4l8889-21apt-get09:55:180
134291160,1ptp4l26954-21diskstats10:30:230
134291160,1ptp4l23103-21snmp_o5powerctl10:20:331
134291160,1ptp4l13104-21hddtemp_smartct12:10:200
134291160,0ptp4l121rcu_preempt10:35:240
134291160,0ptp4l0-21swapper/111:30:271
134291160,0ptp4l0-21swapper/109:32:591
134291160,0ptp4l0-21swapper/011:00:210
134291150,1ptp4l8615-21irqstats08:45:261
134291150,1ptp4l8569-21python10:55:271
134291150,1ptp4l8194-21hddtemp_smartct08:45:240
134291150,1ptp4l2873-21snmp_o5powerctl09:40:310
134291150,1ptp4l25530-21df12:35:231
134291150,1ptp4l23325-21if_enp4s012:30:241
134291150,1ptp4l20831-21diskstats09:10:211
134291150,1ptp4l20540-21snmp_o5powerctl08:00:261
134291150,1ptp4l1461-21snmp_o5powerctl11:45:330
134291150,1ptp4l14085-21snmp_o5powerctl12:10:281
134291150,0ptp4l0-21swapper/112:20:021
134291150,0ptp4l0-21swapper/111:25:201
134291150,0ptp4l0-21swapper/110:50:271
134291150,0ptp4l0-21swapper/107:55:281
134291150,0ptp4l0-21swapper/107:53:351
134291150,0ptp4l0-21swapper/011:55:190
134291150,0ptp4l0-21swapper/008:15:190
134291150,0ptp4l0-21swapper/007:25:200
2515799140,12cyclictest11708-21snmp_o5powerctl08:50:363
134291140,1ptp4l31672-21cpu10:40:171
134291140,1ptp4l29690-21latency_hist11:40:011
134291140,1ptp4l2908-21df08:35:221
134291140,1ptp4l28484-21cat09:30:011
134291140,1ptp4l25-21ksoftirqd/111:45:281
134291140,1ptp4l25152-21cyclictest07:10:170
134291140,1ptp4l24997-21df_inode08:15:201
134291140,1ptp4l23071-21snmp_o5powerctl08:05:310
134291140,1ptp4l19393-21fschecks_count08:00:190
134291140,1ptp4l17464-21irqstats10:10:260
134291140,1ptp4l11271-21ntpq12:05:311
134291140,1ptp4l1044-21sleep07:25:011
134291140,0ptp4l0-21swapper/209:30:192
134291140,0ptp4l0-21swapper/207:40:292
134291140,0ptp4l0-21swapper/207:15:222
134291140,0ptp4l0-21swapper/112:25:281
134291140,0ptp4l0-21swapper/111:50:231
134291140,0ptp4l0-21swapper/111:40:261
134291140,0ptp4l0-21swapper/111:20:271
134291140,0ptp4l0-21swapper/110:45:021
134291140,0ptp4l0-21swapper/110:35:221
134291140,0ptp4l0-21swapper/110:30:251
134291140,0ptp4l0-21swapper/110:15:271
134291140,0ptp4l0-21swapper/110:10:261
134291140,0ptp4l0-21swapper/110:05:261
134291140,0ptp4l0-21swapper/109:55:301
134291140,0ptp4l0-21swapper/109:50:271
134291140,0ptp4l0-21swapper/109:40:261
134291140,0ptp4l0-21swapper/109:20:301
134291140,0ptp4l0-21swapper/109:05:281
134291140,0ptp4l0-21swapper/108:55:341
134291140,0ptp4l0-21swapper/108:40:241
134291140,0ptp4l0-21swapper/108:25:391
134291140,0ptp4l0-21swapper/108:20:301
134291140,0ptp4l0-21swapper/108:08:131
134291140,0ptp4l0-21swapper/107:40:221
134291140,0ptp4l0-21swapper/107:25:221
134291140,0ptp4l0-21swapper/107:10:201
134291140,0ptp4l0-21swapper/012:30:200
134291140,0ptp4l0-21swapper/012:20:180
134291140,0ptp4l0-21swapper/011:30:270
134291140,0ptp4l0-21swapper/011:25:240
134291140,0ptp4l0-21swapper/011:20:220
134291140,0ptp4l0-21swapper/011:15:320
134291140,0ptp4l0-21swapper/010:25:370
134291140,0ptp4l0-21swapper/009:45:230
134291140,0ptp4l0-21swapper/009:30:180
134291140,0ptp4l0-21swapper/009:15:290
134291140,0ptp4l0-21swapper/009:05:330
134291140,0ptp4l0-21swapper/008:40:310
134291140,0ptp4l0-21swapper/008:35:230
134291140,0ptp4l0-21swapper/007:50:180
134291140,0ptp4l0-21swapper/007:45:180
134291140,0ptp4l0-21swapper/007:35:300
134291140,0ptp4l0-21swapper/007:30:220
134291140,0ptp4l0-21swapper/007:15:240
2515599131,6cyclictest0-21swapper/107:45:191
134291130,2ptp4l0-21swapper/207:10:242
134291130,1ptp4l8985-21grep07:40:170
134291130,1ptp4l0-21swapper/211:50:232
134291130,0ptp4l0-21swapper/212:35:272
134291130,0ptp4l0-21swapper/211:55:262
134291130,0ptp4l0-21swapper/211:45:302
134291130,0ptp4l0-21swapper/210:50:322
134291130,0ptp4l0-21swapper/210:00:262
134291130,0ptp4l0-21swapper/209:40:332
134291130,0ptp4l0-21swapper/209:10:312
134291130,0ptp4l0-21swapper/112:15:191
134291130,0ptp4l0-21swapper/112:00:201
134291130,0ptp4l0-21swapper/111:55:221
134291130,0ptp4l0-21swapper/111:15:221
134291130,0ptp4l0-21swapper/111:05:221
134291130,0ptp4l0-21swapper/111:00:201
134291130,0ptp4l0-21swapper/110:25:011
134291130,0ptp4l0-21swapper/110:00:201
134291130,0ptp4l0-21swapper/109:45:141
134291130,0ptp4l0-21swapper/109:35:231
134291130,0ptp4l0-21swapper/109:15:241
134291130,0ptp4l0-21swapper/109:00:171
134291130,0ptp4l0-21swapper/108:50:271
134291130,0ptp4l0-21swapper/108:30:231
134291130,0ptp4l0-21swapper/108:10:011
134291130,0ptp4l0-21swapper/107:35:241
134291130,0ptp4l0-21swapper/107:30:211
134291130,0ptp4l0-21swapper/012:25:210
134291130,0ptp4l0-21swapper/012:15:180
134291130,0ptp4l0-21swapper/012:05:300
134291130,0ptp4l0-21swapper/012:00:190
134291130,0ptp4l0-21swapper/011:40:210
134291130,0ptp4l0-21swapper/011:35:290
134291130,0ptp4l0-21swapper/011:10:220
134291130,0ptp4l0-21swapper/011:05:250
134291130,0ptp4l0-21swapper/010:55:240
134291130,0ptp4l0-21swapper/010:50:210
134291130,0ptp4l0-21swapper/010:40:270
134291130,0ptp4l0-21swapper/010:15:250
134291130,0ptp4l0-21swapper/010:05:250
134291130,0ptp4l0-21swapper/010:00:190
134291130,0ptp4l0-21swapper/009:50:190
134291130,0ptp4l0-21swapper/009:25:160
134291130,0ptp4l0-21swapper/009:25:010
134291130,0ptp4l0-21swapper/009:10:220
134291130,0ptp4l0-21swapper/009:00:200
134291130,0ptp4l0-21swapper/008:55:310
134291130,0ptp4l0-21swapper/008:50:260
134291130,0ptp4l0-21swapper/008:30:220
134291130,0ptp4l0-21swapper/008:25:280
134291130,0ptp4l0-21swapper/008:20:230
134291130,0ptp4l0-21swapper/007:20:290
2515799121,9cyclictest0-21swapper/312:00:243
2515799121,10cyclictest26601-21apt-get10:30:213
2515799120,11cyclictest21605-21ls10:20:223
134291120,0ptp4l0-21swapper/210:45:202
134291120,0ptp4l0-21swapper/209:45:222
134291120,0ptp4l0-21swapper/208:35:282
134291120,0ptp4l0-21swapper/208:30:262
2515799116,4cyclictest5153-21cat11:55:203
2515799116,4cyclictest31536-21expr07:20:213
2515799116,4cyclictest25332-21expr12:35:233
2515799115,5cyclictest8769-21cat08:45:273
2515799115,5cyclictest12672-21sh07:45:253
134291110,1ptp4l12071-21/usr/sbin/munin11:05:322
134291110,0ptp4l0-21swapper/210:20:222
134291110,0ptp4l0-21swapper/207:20:272
2515799105,4cyclictest84372sleep307:37:493
2515799105,4cyclictest58602sleep307:32:033
2515799105,4cyclictest23061-21sed11:25:253
2515799105,4cyclictest19679-21taskset09:05:563
2515799105,4cyclictest19633-21sed11:20:013
2515799105,4cyclictest16804-21taskset11:14:023
2515799105,4cyclictest13333-21ntp_kernel_pll_11:05:303
2515799104,5cyclictest4380-21sed09:45:163
2515799104,5cyclictest29150-21grep09:30:183
2515799101,8cyclictest32123-21perl10:40:193
2515799100,7cyclictest0-21swapper/308:00:283
2515799100,1cyclictest18210-21awk12:20:213
2515799100,0cyclictest0-21swapper/308:40:333
2515799100,0cyclictest0-21swapper/308:30:003
134291100,1ptp4l0-21swapper/210:37:072
134291100,1ptp4l0-21swapper/208:27:522
134291100,0ptp4l0-21swapper/307:15:223
134291100,0ptp4l0-21swapper/212:25:272
134291100,0ptp4l0-21swapper/212:08:272
134291100,0ptp4l0-21swapper/211:35:222
134291100,0ptp4l0-21swapper/211:15:592
134291100,0ptp4l0-21swapper/209:53:052
134291100,0ptp4l0-21swapper/208:50:322
134291100,0ptp4l0-21swapper/207:30:222
251579997,1cyclictest24888-21expr08:15:203
251579997,1cyclictest19007-21egrep10:15:213
251579997,1cyclictest142432sleep308:55:363
251579997,1cyclictest10864-21tr12:05:283
251579994,4cyclictest3488-21chrt07:28:593
251579994,4cyclictest30219-21memory10:35:313
251579994,4cyclictest25549-21chrt09:20:413
251579994,4cyclictest16808-21expr10:10:223
251579993,5cyclictest9368-21grep07:40:183
251579993,5cyclictest4117-21cat11:50:323
251579993,5cyclictest24374-21sed12:30:303
251579992,6cyclictest29896-21tr11:40:223
251579991,3cyclictest1282-21snmpd11:30:203
251579990,8cyclictest2221-21tr09:40:253
251569997,1cyclictest9791-21tr09:55:232
251569997,1cyclictest327502sleep210:40:222
251569997,1cyclictest2682-21head07:25:272
251569997,1cyclictest25725-21cat08:15:232
13429190,1ptp4l2515699cyclictest11:00:102
13429190,0ptp4l0-21swapper/212:21:532
13429190,0ptp4l0-21swapper/212:17:022
13429190,0ptp4l0-21swapper/212:11:012
13429190,0ptp4l0-21swapper/212:02:232
13429190,0ptp4l0-21swapper/211:44:022
13429190,0ptp4l0-21swapper/211:31:002
13429190,0ptp4l0-21swapper/211:26:492
13429190,0ptp4l0-21swapper/211:20:422
13429190,0ptp4l0-21swapper/211:12:442
13429190,0ptp4l0-21swapper/210:55:312
13429190,0ptp4l0-21swapper/210:31:582
13429190,0ptp4l0-21swapper/210:27:562
13429190,0ptp4l0-21swapper/210:15:012
13429190,0ptp4l0-21swapper/210:10:552
13429190,0ptp4l0-21swapper/210:06:412
13429190,0ptp4l0-21swapper/209:36:282
13429190,0ptp4l0-21swapper/209:28:552
13429190,0ptp4l0-21swapper/209:21:012
13429190,0ptp4l0-21swapper/209:16:222
13429190,0ptp4l0-21swapper/209:06:242
13429190,0ptp4l0-21swapper/209:02:272
13429190,0ptp4l0-21swapper/208:57:282
13429190,0ptp4l0-21swapper/208:46:062
13429190,0ptp4l0-21swapper/208:43:462
13429190,0ptp4l0-21swapper/208:22:522
13429190,0ptp4l0-21swapper/208:10:052
13429190,0ptp4l0-21swapper/208:05:362
13429190,0ptp4l0-21swapper/208:00:232
13429190,0ptp4l0-21swapper/207:58:282
13429190,0ptp4l0-21swapper/207:45:152
13429190,0ptp4l0-21swapper/207:35:402
13429190,0ptp4l0-21swapper/008:10:020
251579986,1cyclictest6555-21cat09:50:173
251579986,1cyclictest505-21cat09:35:383
251579986,1cyclictest32506-21ls11:45:243
251579986,1cyclictest29027-21tail08:20:303
251579986,1cyclictest2721-21cut08:35:223
251579986,1cyclictest26336-21sort07:10:203
251579986,1cyclictest26304-21seq09:25:143
251579986,1cyclictest25713-21expr10:25:383
251579986,1cyclictest25111-21chrt09:18:053
251579986,1cyclictest240312sleep308:10:313
251579986,1cyclictest21883-21wc09:10:263
251579986,1cyclictest21860-21expr08:05:223
251579986,1cyclictest21758-21cat12:25:333
251579986,1cyclictest20408-21cat11:20:243
251579986,1cyclictest1948-21chrt10:45:123
251579986,1cyclictest16661-21expr07:55:203
251579986,1cyclictest15563-21df09:00:183
251579986,1cyclictest15473-21tune2fs12:15:183
251579986,1cyclictest14218-21expr10:05:243
251579986,1cyclictest11939-21head10:00:203
251579986,1cyclictest10744-21chrt11:00:253
251579983,4cyclictest7234-21cat10:55:203
251579982,5cyclictest32526-21cat08:30:203
251579982,5cyclictest14229-21expr07:50:173
251579980,0cyclictest0-21swapper/309:59:133
251569987,1cyclictest15869-21chrt07:50:522
251569986,1cyclictest24041-21tr12:30:272
251579970,6cyclictest4501-21cat10:50:183
251579970,6cyclictest28373-21sort11:35:293
251579970,1cyclictest13139-21idleruntime12:10:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional