You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-04 - 22:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Wed Oct 04, 2023 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2841996211972,19sleep20-21swapper/219:08:462
2841792211570,18sleep00-21swapper/019:06:120
2841968211470,19sleep10-21swapper/119:08:251
292077821030,0sleep20-21swapper/221:43:502
2840559210174,20sleep30-21swapper/319:05:193
284222799758,45cyclictest0-21swapper/000:21:210
284222799758,45cyclictest0-21swapper/000:21:200
2842227996463,1cyclictest3040910-21sensors00:10:300
2842227996461,2cyclictest3025374-21rm23:51:240
284223599620,61cyclictest0-21swapper/220:55:272
2842227996261,1cyclictest3057169-21sensors00:30:270
284222799620,61cyclictest0-21swapper/022:52:000
2842227996160,1cyclictest2852368-21ntpq19:30:260
284222799610,61cyclictest0-21swapper/022:31:210
284222799610,0cyclictest0-21swapper/023:10:560
2842240996059,1cyclictest1036-21snmpd22:45:223
2842235996059,1cyclictest2846256-21sensors19:15:282
2842231996059,1cyclictest2983922-21sensors23:00:301
2842227996059,1cyclictest2862936-21sensors19:55:250
2842227996059,1cyclictest0-21swapper/021:05:190
284222799600,0cyclictest0-21swapper/020:58:400
284224099590,58cyclictest0-21swapper/320:30:283
2842231995958,1cyclictest2996125-21sensors23:15:281
2842227995958,0cyclictest2877885-21vmstat20:30:310
284222799590,59cyclictest0-21swapper/023:07:010
284222799590,59cyclictest0-21swapper/019:51:260
284222799590,58cyclictest0-21swapper/022:25:260
284222799590,58cyclictest0-21swapper/021:16:050
2842240995857,1cyclictest2867128-21sensors20:05:283
284223599580,1cyclictest0-21swapper/200:30:272
2842231995857,1cyclictest3000188-21sensors23:20:281
2842231995857,1cyclictest2854603-21sensors19:35:291
2842227995857,1cyclictest0-21swapper/023:26:070
2842227995856,1cyclictest2979603-21netstat22:55:240
2842227995855,2cyclictest3062844-21sh00:38:100
284222799580,1cyclictest0-21swapper/021:48:510
2842227995757,0cyclictest0-21swapper/023:04:160
2842227995756,0cyclictest0-21swapper/023:30:030
2842227995756,0cyclictest0-21swapper/022:45:210
2842227995755,1cyclictest3016300-21ntpq23:40:270
2842231995655,1cyclictest2892164-21sensors21:05:261
2842231995655,1cyclictest1036-21snmpd23:45:321
2842227995656,0cyclictest0-21swapper/022:11:220
2842227995655,1cyclictest2919413-21ssh21:40:590
2842227995655,1cyclictest2902552-21sensors21:20:280
2842227995655,1cyclictest0-21swapper/023:58:020
2842227995655,1cyclictest0-21swapper/021:53:070
2842227995655,1cyclictest0-21swapper/019:25:290
2842227995655,1cyclictest0-21swapper/000:19:530
2842227995655,0cyclictest2964786-21sh22:37:190
2842227995655,0cyclictest0-21swapper/023:15:320
2842227995655,0cyclictest0-21swapper/021:32:380
284222799560,55cyclictest0-21swapper/000:05:220
2842235995554,1cyclictest2873375-21sensors20:20:262
2842235995554,1cyclictest0-21swapper/220:10:322
284223199550,55cyclictest0-21swapper/119:54:491
2842227995555,0cyclictest0-21swapper/023:35:210
2842227995555,0cyclictest0-21swapper/022:20:260
2842227995555,0cyclictest0-21swapper/019:10:280
2842227995554,1cyclictest1036-21snmpd00:25:390
2842227995554,1cyclictest0-21swapper/022:18:230
2842227995554,1cyclictest0-21swapper/021:37:040
2842227995551,1cyclictest151rcu_preempt21:12:090
2842235995453,1cyclictest2963603-21sensors22:35:312
2842235995453,1cyclictest2902550-21sensors21:20:272
2842231995453,1cyclictest1036-21snmpd20:29:571
2842227995454,0cyclictest0-21swapper/021:55:400
2842227995454,0cyclictest0-21swapper/020:54:030
2842227995453,1cyclictest0-21swapper/023:45:140
2842227995453,1cyclictest0-21swapper/023:22:540
2842227995453,1cyclictest0-21swapper/022:01:490
2842227995453,0cyclictest2939745-21ssh22:05:550
2842227995452,2cyclictest3032559-21ntpq00:00:250
2842240995352,1cyclictest2843532-21sensors19:10:283
2842240995352,1cyclictest0-21swapper/323:25:283
2842231995352,1cyclictest0-21swapper/121:10:301
2842227995353,0cyclictest0-21swapper/022:42:460
2842227995352,1cyclictest2906619-21sensors21:25:280
2842227995352,1cyclictest0-21swapper/019:35:430
2842227995351,1cyclictest0-21swapper/019:48:520
2842240995251,1cyclictest0-21swapper/322:35:303
2842227995252,0cyclictest0-21swapper/020:45:320
2842227995251,1cyclictest0-21swapper/019:43:140
2842227995251,0cyclictest0-21swapper/020:36:380
2842227995251,0cyclictest0-21swapper/020:14:590
2842227995251,0cyclictest0-21swapper/020:07:280
2842227995251,0cyclictest0-21swapper/020:03:120
2842227995250,1cyclictest0-21swapper/021:01:550
2842227995250,1cyclictest0-21swapper/020:42:480
2842240995150,1cyclictest0-21swapper/321:05:273
2842240995149,1cyclictest2925719-21ssh21:50:123
2842231995150,1cyclictest0-21swapper/122:55:291
2842227995151,0cyclictest0-21swapper/020:20:250
2842227995150,1cyclictest0-21swapper/020:27:160
2842227995150,0cyclictest0-21swapper/019:20:220
2842227995149,1cyclictest0-21swapper/020:15:500
2842227995149,1cyclictest0-21swapper/019:18:390
2842240995049,1cyclictest1036-21snmpd20:24:563
2842235995047,3cyclictest2890067-21sensors21:00:282
2842231995049,1cyclictest0-21swapper/120:50:271
2842240994948,1cyclictest0-21swapper/323:20:273
2842235994948,1cyclictest2971737-21sensors22:45:302
2842231994948,1cyclictest0-21swapper/121:20:271
2842240994847,1cyclictest1036-21snmpd23:30:303
2842231994847,1cyclictest3012369-21sensors23:35:261
2842235994746,1cyclictest0-21swapper/222:25:272
2842231994746,1cyclictest0-21swapper/100:00:291
2842240994645,1cyclictest2983919-21sensors23:00:303
2842231994645,1cyclictest2862942-21sensors19:55:261
2842231994645,1cyclictest0-21swapper/120:04:511
2842231994645,1cyclictest0-21swapper/119:20:241
2842240994443,1cyclictest0-21swapper/319:30:293
2842235994241,1cyclictest2848332-21sensors19:20:242
2842235994241,1cyclictest0-21swapper/223:35:312
2842240994140,1cyclictest0-21swapper/300:05:373
2842235994140,1cyclictest0-21swapper/219:59:502
2842231994140,1cyclictest2935144-21sensors22:00:311
2842240994039,1cyclictest0-21swapper/319:25:293
2842240993938,1cyclictest2914771-21sensors21:35:283
2842231993837,1cyclictest1036-21snmpd21:25:071
2842231993837,1cyclictest0-21swapper/120:09:521
2842240993736,1cyclictest0-21swapper/323:50:273
2842235993736,1cyclictest0-21swapper/223:05:302
2842231993736,1cyclictest2879645-21sensors20:35:311
2842231993635,1cyclictest0-21swapper/119:25:291
2842240993534,1cyclictest0-21swapper/321:45:293
2842231993534,1cyclictest0-21swapper/123:40:301
2842231993534,1cyclictest0-21swapper/122:10:281
2842231993534,1cyclictest0-21swapper/119:40:311
2842235993433,1cyclictest0-21swapper/200:00:292
2842235993332,1cyclictest0-21swapper/223:15:292
2842235993231,1cyclictest2881725-21sensors20:40:302
2842235993231,1cyclictest0-21swapper/223:00:302
2842235993231,1cyclictest0-21swapper/219:30:292
2842240993130,1cyclictest0-21swapper/322:30:293
2842240993130,1cyclictest0-21swapper/321:40:313
2842235993130,1cyclictest0-21swapper/221:05:022
2842240993029,1cyclictest1036-21snmpd00:00:353
2842235993029,1cyclictest0-21swapper/219:29:442
2842231993029,1cyclictest0-21swapper/121:35:091
2842231993029,1cyclictest0-21swapper/100:15:271
165999300,2ntpd40-21ksoftirqd/320:51:513
2842235992928,1cyclictest0-21swapper/223:10:292
2842235992928,1cyclictest0-21swapper/200:10:292
2842235992924,5cyclictest0-21swapper/222:20:262
2842240992827,1cyclictest2892869-21diskmemload21:20:053
2842240992827,1cyclictest1036-21snmpd19:39:463
2842240992827,1cyclictest0-21swapper/321:30:303
2842235992827,1cyclictest2922900-21sensors21:45:282
284223599278,4cyclictest0-21swapper/219:35:152
2842231992726,1cyclictest0-21swapper/122:15:261
2842240992625,1cyclictest2879643-21sensors20:35:313
2842235992625,1cyclictest0-21swapper/200:35:292
284223599255,5cyclictest2860451-21irqstats19:50:242
2842235992524,1cyclictest2975513-21strings22:50:222
2842240992423,1cyclictest2947318-21sensors22:15:263
2842240992423,1cyclictest2906628-21sensors21:25:293
2842240992423,1cyclictest0-21swapper/300:30:413
2842235992420,1cyclictest0-21swapper/221:31:152
2842231992322,1cyclictest3024595-21sensors23:50:281
284223199230,15cyclictest0-21swapper/100:21:041
284223199230,15cyclictest0-21swapper/100:21:041
2842240992221,1cyclictest0-21swapper/321:15:313
165999220,2ntpd40-21ksoftirqd/322:01:023
165999220,2ntpd33-21ksoftirqd/200:22:542
165999220,2ntpd33-21ksoftirqd/200:22:532
284224099210,4cyclictest0-21swapper/319:55:103
2842235992120,1cyclictest0-21swapper/220:25:302
165999210,2ntpd33-21ksoftirqd/223:29:082
2842240992019,1cyclictest0-21swapper/320:15:263
2842235992019,1cyclictest0-21swapper/219:40:312
284223199209,11cyclictest0-21swapper/120:45:251
2842231992019,1cyclictest2871293-21sensors20:15:261
2842240991918,1cyclictest0-21swapper/321:10:313
284224099190,4cyclictest0-21swapper/320:46:593
284224099190,4cyclictest0-21swapper/319:20:543
2842231991918,1cyclictest0-21swapper/122:40:211
284223599183,15cyclictest0-21swapper/222:09:512
2842235991816,2cyclictest33-1ksoftirqd/200:07:502
284223599180,17cyclictest0-21swapper/222:02:132
2842231991817,1cyclictest2852517-21sensors19:30:291
2842240991716,1cyclictest0-21swapper/321:55:303
284224099170,17cyclictest0-21swapper/300:12:403
284224099170,16cyclictest0-21swapper/320:00:033
284223599177,10cyclictest0-21swapper/221:58:192
284223599170,16cyclictest0-21swapper/220:00:272
2842231991716,1cyclictest0-21swapper/121:30:301
284223199170,1cyclictest0-21swapper/120:32:201
284223199170,17cyclictest0-21swapper/122:33:111
284223199170,16cyclictest0-21swapper/120:40:201
2842240991616,0cyclictest2978248-21ssh22:54:563
284224099160,16cyclictest0-21swapper/321:03:513
2842235991615,1cyclictest0-21swapper/220:45:302
284223599160,16cyclictest0-21swapper/221:27:302
2842231991613,2cyclictest1036-21snmpd23:06:301
284224099150,7cyclictest3018072-21ssh23:43:093
284224099150,7cyclictest0-21swapper/320:42:413
284224099150,7cyclictest0-21swapper/319:53:373
284224099150,0cyclictest0-21swapper/322:14:203
2842235991513,1cyclictest1036-21snmpd23:49:542
284223599150,7cyclictest0-21swapper/219:10:472
284223599150,6cyclictest0-21swapper/223:56:092
284223199150,7cyclictest0-21swapper/100:31:311
2842240991412,2cyclictest0-21swapper/323:35:243
284223599145,9cyclictest0-21swapper/220:35:082
284223599143,10cyclictest2898299-21ntpq21:15:272
2842235991413,1cyclictest2959516-21sensors22:30:292
284223599140,14cyclictest0-21swapper/200:28:342
284223199145,9cyclictest0-21swapper/121:53:331
284223199140,6cyclictest0-21swapper/122:24:521
284223199140,6cyclictest0-21swapper/119:48:151
165999140,3ntpd0-21swapper/223:50:232
284224099139,1cyclictest0-21swapper/300:20:203
284224099139,1cyclictest0-21swapper/300:20:193
284224099134,9cyclictest0-21swapper/319:18:203
284223599134,9cyclictest0-21swapper/220:32:382
284223599130,5cyclictest0-21swapper/222:57:202
284223199134,9cyclictest0-21swapper/121:55:271
284224099129,2cyclictest1036-21snmpd23:16:573
284224099129,2cyclictest1036-21snmpd23:07:083
284224099129,2cyclictest1036-21snmpd22:40:583
284224099129,2cyclictest1036-21snmpd22:22:583
284224099129,2cyclictest1036-21snmpd19:48:573
284224099123,9cyclictest427-21plymouthd20:58:003
284224099123,9cyclictest0-21swapper/322:27:023
2842240991210,2cyclictest1036-21snmpd20:27:053
284224099120,12cyclictest0-21swapper/322:05:173
284223599129,2cyclictest1036-21snmpd23:40:152
284223199122,9cyclictest2843378-21ntp_states19:10:261
284223199122,5cyclictest2922862-21ssh21:45:281
2842231991211,1cyclictest0-21swapper/121:02:121
284223199121,10cyclictest2973496-21ssh22:48:301
284223199121,10cyclictest0-21swapper/121:15:211
2842231991210,2cyclictest1036-21snmpd21:41:011
2842231991210,1cyclictest1036-21snmpd20:24:561
284223599118,2cyclictest1036-21snmpd23:23:512
284223599112,9cyclictest0-21swapper/221:14:302
2842235991110,1cyclictest0-21swapper/219:46:332
284223599110,10cyclictest0-21swapper/221:50:062
284223199119,1cyclictest1036-21snmpd23:30:301
284223199118,2cyclictest1036-21snmpd23:14:111
284223199118,2cyclictest1036-21snmpd22:25:221
165999110,1ntpd33-21ksoftirqd/200:15:222
284224099108,2cyclictest1036-21snmpd00:19:343
284224099100,9cyclictest0-21swapper/322:55:023
284224099100,10cyclictest0-21swapper/320:13:013
284224099100,10cyclictest0-21swapper/319:41:063
284224099100,10cyclictest0-21swapper/300:26:103
284223599107,2cyclictest1036-21snmpd23:33:002
284223599107,2cyclictest1036-21snmpd22:44:192
284223599107,2cyclictest1036-21snmpd20:50:262
284223599100,9cyclictest0-21swapper/222:15:142
284223599100,9cyclictest0-21swapper/220:18:102
284223599100,10cyclictest0-21swapper/222:11:342
284223599100,10cyclictest0-21swapper/221:35:452
284223599100,10cyclictest0-21swapper/220:06:192
284223199108,2cyclictest1036-21snmpd00:35:271
284223199107,2cyclictest1036-21snmpd22:09:241
284223199100,9cyclictest0-21swapper/100:10:101
284223199100,10cyclictest0-21swapper/123:59:421
284223199100,10cyclictest0-21swapper/122:36:591
284223199100,10cyclictest0-21swapper/120:57:301
284223199100,10cyclictest0-21swapper/119:17:531
28422409990,1cyclictest0-21swapper/323:55:283
28422409990,0cyclictest0-21swapper/300:39:353
28422319990,9cyclictest0-21swapper/120:11:401
28422319990,9cyclictest0-21swapper/100:27:041
28422319986,2cyclictest1036-21snmpd22:52:091
28422319984,1cyclictest0-21swapper/100:07:441
28422409975,2cyclictest1036-21snmpd23:45:363
28422409970,7cyclictest0-21swapper/323:13:323
28422319976,1cyclictest1036-21snmpd23:27:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional