You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 01:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot7s.osadl.org (updated Sun May 04, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
328397211970,21sleep10-21swapper/119:05:371
328664211868,22sleep00-21swapper/019:09:050
328731211367,38sleep30-21swapper/319:09:563
328423211265,19sleep20-21swapper/219:05:582
32890199928,42cyclictest0-21swapper/022:55:240
328907992624,2cyclictest342178-21memory19:40:242
32890199260,25cyclictest0-21swapper/022:17:180
32890199260,25cyclictest0-21swapper/020:52:060
32890199260,25cyclictest0-21swapper/000:16:190
32890799256,1cyclictest0-21swapper/219:11:122
32890799240,16cyclictest354148-21ntpq20:10:162
32890399240,15cyclictest0-21swapper/123:56:241
32890199240,16cyclictest0-21swapper/023:36:030
32890799207,1cyclictest0-21swapper/221:02:332
32890799199,10cyclictest0-21swapper/220:52:572
32890799185,13cyclictest0-21swapper/222:51:302
328907991815,2cyclictest1051-21snmpd22:26:052
32890799180,17cyclictest0-21swapper/223:25:112
32890199180,17cyclictest0-21swapper/023:10:050
32890199180,17cyclictest0-21swapper/021:49:250
32890199180,17cyclictest0-21swapper/019:10:070
328909991716,1cyclictest0-21swapper/300:08:063
328909991715,1cyclictest1051-21snmpd21:20:043
328909991715,1cyclictest1051-21snmpd20:32:323
32890999170,17cyclictest0-21swapper/322:08:393
32890999170,16cyclictest0-21swapper/319:39:303
32890999170,16cyclictest0-21swapper/300:12:193
32890799178,0cyclictest0-21swapper/219:35:182
32890799177,10cyclictest0-21swapper/220:02:132
328907991714,2cyclictest1051-21snmpd23:33:052
328907991711,6cyclictest0-21swapper/223:19:102
32890799170,17cyclictest0-21swapper/220:44:062
32890799170,17cyclictest0-21swapper/219:22:152
32890799170,17cyclictest0-21swapper/219:19:572
32890799170,17cyclictest0-21swapper/200:03:162
32890399170,1cyclictest0-21swapper/121:55:261
32890399170,17cyclictest0-21swapper/121:26:201
32890199170,17cyclictest0-21swapper/023:31:260
32890199170,17cyclictest0-21swapper/022:21:570
32890199170,17cyclictest0-21swapper/021:59:290
32890199170,17cyclictest0-21swapper/019:52:460
32890199170,16cyclictest0-21swapper/021:35:080
32890199170,16cyclictest0-21swapper/021:09:070
32890199170,16cyclictest0-21swapper/021:09:060
32890199170,16cyclictest0-21swapper/020:48:030
32890999160,15cyclictest0-21swapper/322:41:193
32890999160,15cyclictest0-21swapper/321:00:483
328907991613,2cyclictest1051-21snmpd20:05:282
328907991612,4cyclictest0-21swapper/222:30:172
328907991612,4cyclictest0-21swapper/221:25:132
32890799160,8cyclictest0-21swapper/220:57:322
32890799160,16cyclictest0-21swapper/222:57:082
32890799160,16cyclictest0-21swapper/222:08:362
32890799160,16cyclictest0-21swapper/221:24:372
32890799160,16cyclictest0-21swapper/220:16:322
328903991615,1cyclictest1051-21snmpd20:12:371
328903991613,2cyclictest1045-21nmbd19:42:191
32890399160,7cyclictest0-21swapper/120:37:201
32890399160,7cyclictest0-21swapper/119:18:421
328901991614,1cyclictest0-21swapper/021:10:250
32890199160,16cyclictest0-21swapper/021:50:470
32890199160,16cyclictest0-21swapper/019:43:490
32890199160,15cyclictest0-21swapper/020:28:380
32890999155,9cyclictest0-21swapper/321:45:203
32890999150,15cyclictest0-21swapper/323:04:043
32890799152,1cyclictest0-21swapper/221:09:342
32890799152,1cyclictest0-21swapper/221:09:342
328907991512,2cyclictest1051-21snmpd21:44:292
328907991511,4cyclictest0-21swapper/221:55:162
32890799150,1cyclictest0-21swapper/219:30:212
32890799150,15cyclictest0-21swapper/220:30:322
32890799150,15cyclictest0-21swapper/219:54:552
32890399150,15cyclictest0-21swapper/121:41:141
32890399150,15cyclictest0-21swapper/120:41:261
32890399150,13cyclictest0-21swapper/122:45:171
328901991514,1cyclictest1051-21snmpd00:00:540
328901991511,4cyclictest0-21swapper/020:43:420
328901991511,4cyclictest0-21swapper/020:21:320
328901991511,4cyclictest0-21swapper/000:12:150
32890199150,7cyclictest0-21swapper/021:21:370
32890199150,7cyclictest0-21swapper/020:10:010
32890199150,15cyclictest0-21swapper/023:23:230
32890199150,15cyclictest0-21swapper/023:01:020
32890199150,15cyclictest0-21swapper/000:35:250
32890199150,14cyclictest0-21swapper/022:30:180
32890999144,9cyclictest0-21swapper/322:54:553
328909991412,1cyclictest0-21swapper/322:15:423
32890799149,4cyclictest0-21swapper/221:10:162
32890799145,9cyclictest0-21swapper/221:52:382
328907991413,1cyclictest0-21swapper/223:50:182
328907991412,1cyclictest0-21swapper/200:10:112
32890799140,14cyclictest0-21swapper/200:30:162
32890799140,13cyclictest0-21swapper/223:35:142
32890399140,6cyclictest0-21swapper/123:17:011
32890399140,6cyclictest0-21swapper/119:35:281
32890399140,5cyclictest0-21swapper/121:19:311
32890399140,5cyclictest0-21swapper/100:21:131
32890199144,9cyclictest0-21swapper/023:55:190
32890199144,9cyclictest0-21swapper/022:52:480
32890199142,10cyclictest355601-21diskstats20:15:160
328901991410,1cyclictest0-21swapper/023:44:420
32890999133,9cyclictest329897-21ntp_states19:10:203
32890999133,4cyclictest419302-21ntpq22:55:173
32890999132,10cyclictest0-21swapper/300:34:283
32890799139,4cyclictest0-21swapper/223:04:582
32890799139,4cyclictest0-21swapper/222:22:302
32890799139,4cyclictest0-21swapper/222:00:572
32890799133,10cyclictest0-21swapper/223:11:412
328907991312,1cyclictest0-21swapper/200:15:202
328907991310,3cyclictest0-21swapper/219:46:042
328907991310,2cyclictest1051-21snmpd23:24:002
328907991310,2cyclictest1051-21snmpd21:16:302
32890799130,1cyclictest0-21swapper/220:35:352
32890799130,13cyclictest0-21swapper/222:40:172
328903991312,1cyclictest1051-21snmpd22:58:291
328903991312,1cyclictest1051-21snmpd00:35:011
328903991312,1cyclictest0-21swapper/121:30:201
328903991310,2cyclictest1051-21snmpd23:48:391
328903991310,2cyclictest1051-21snmpd21:00:481
32890399130,13cyclictest0-21swapper/120:30:591
32890199133,10cyclictest0-21swapper/020:38:200
328901991312,1cyclictest1051-21snmpd22:39:130
328901991312,1cyclictest0-21swapper/021:30:170
328901991311,1cyclictest1051-21snmpd19:58:520
328901991310,2cyclictest872-21abrt-dump-journ23:44:590
32890199130,13cyclictest0-21swapper/019:20:210
32890999129,2cyclictest872-21abrt-dump-journ21:50:003
32890999129,2cyclictest1051-21snmpd21:11:163
32890999129,2cyclictest1051-21snmpd19:26:543
32890999127,4cyclictest0-21swapper/320:07:223
328909991211,1cyclictest0-21swapper/323:48:523
328909991211,1cyclictest0-21swapper/319:49:073
328909991210,1cyclictest1051-21snmpd23:16:013
328909991210,1cyclictest0-21swapper/319:20:163
32890999120,11cyclictest0-21swapper/320:48:393
32890999120,11cyclictest0-21swapper/300:16:383
32890799129,2cyclictest1051-21snmpd23:40:412
32890799129,2cyclictest1051-21snmpd22:19:212
32890799129,2cyclictest1051-21snmpd00:22:432
32890799129,2cyclictest1051-21snmpd00:09:572
32890799127,5cyclictest0-21swapper/221:31:342
32890799127,5cyclictest0-21swapper/219:57:282
32890799127,4cyclictest0-21swapper/221:45:082
328907991210,1cyclictest1051-21snmpd22:38:542
32890399129,2cyclictest1051-21snmpd22:41:191
32890399129,2cyclictest1051-21snmpd22:32:251
32890399129,2cyclictest1051-21snmpd20:22:261
328903991210,1cyclictest1051-21snmpd23:24:061
328903991210,1cyclictest1051-21snmpd20:48:391
32890199129,2cyclictest1558-21crond20:04:590
32890199129,2cyclictest1550-21ntpd22:11:350
32890199128,4cyclictest0-21swapper/022:26:140
32890199128,4cyclictest0-21swapper/000:20:350
32890199128,2cyclictest526-21systemd-journal23:04:580
32890199127,5cyclictest0-21swapper/021:19:580
32890199123,9cyclictest0-21swapper/019:16:240
32890999119,1cyclictest1051-21snmpd23:23:303
32890999119,1cyclictest1051-21snmpd21:41:293
32890999119,1cyclictest1051-21snmpd20:35:203
32890999119,1cyclictest1051-21snmpd00:36:583
32890999119,1cyclictest1051-21snmpd00:25:073
32890999119,1cyclictest1045-21nmbd22:46:193
32890999118,2cyclictest346345-21pmu-power19:50:223
32890999118,2cyclictest1051-21snmpd23:11:143
32890999118,2cyclictest1051-21snmpd19:30:243
32890999117,4cyclictest0-21swapper/323:25:533
32890999117,4cyclictest0-21swapper/321:05:303
32890999117,4cyclictest0-21swapper/321:05:303
32890999117,4cyclictest0-21swapper/320:59:273
32890999111,10cyclictest0-21swapper/323:34:173
32890999111,10cyclictest0-21swapper/321:59:253
328909991110,1cyclictest0-21swapper/322:30:343
328909991110,1cyclictest0-21swapper/321:17:333
32890999110,10cyclictest0-21swapper/323:41:203
32890999110,10cyclictest0-21swapper/323:05:593
32890999110,10cyclictest0-21swapper/320:42:253
32890999110,10cyclictest0-21swapper/319:59:073
32890799119,1cyclictest0-21swapper/220:23:562
32890799118,2cyclictest1051-21snmpd22:46:162
32890799110,11cyclictest0-21swapper/220:45:252
32890399119,2cyclictest1051-21snmpd00:34:291
32890399119,2cyclictest1051-21snmpd00:04:541
32890399119,1cyclictest1051-21snmpd22:08:211
32890399118,2cyclictest391110-21df_abs21:45:141
32890399118,2cyclictest370032-21pmu-power20:50:231
32890399118,2cyclictest1051-21snmpd23:41:201
32890399118,2cyclictest1051-21snmpd00:26:521
328903991110,1cyclictest1051-21snmpd23:51:101
32890399110,1cyclictest0-21swapper/122:54:071
32890399110,1cyclictest0-21swapper/120:00:491
32890399110,11cyclictest0-21swapper/122:18:061
32890399110,11cyclictest0-21swapper/119:45:371
32890399110,10cyclictest0-21swapper/122:35:121
32890399110,10cyclictest0-21swapper/120:25:321
32890199119,2cyclictest987-21gdbus21:45:000
32890199119,2cyclictest1051-21snmpd20:30:310
32890199118,2cyclictest349350-21/usr/sbin/munin20:00:180
32890199116,5cyclictest0-21swapper/000:29:460
328901991110,1cyclictest0-21swapper/023:28:540
32890199110,11cyclictest0-21swapper/021:03:570
32890199110,10cyclictest0-21swapper/020:55:030
32890999108,1cyclictest1051-21snmpd23:36:333
32890999107,2cyclictest443074-21cut23:55:233
32890999107,2cyclictest404976-21fschecks_count22:20:133
32890999107,2cyclictest1051-21snmpd22:28:553
32890999107,2cyclictest1051-21snmpd20:29:473
32890999106,1cyclictest0-21swapper/320:15:373
32890999106,1cyclictest0-21swapper/300:02:013
32890999100,10cyclictest0-21swapper/323:51:093
32890999100,10cyclictest0-21swapper/322:05:003
32890999100,10cyclictest0-21swapper/321:27:463
32890999100,10cyclictest0-21swapper/320:50:203
32890999100,10cyclictest0-21swapper/319:41:483
32890999100,10cyclictest0-21swapper/300:22:253
32890799108,1cyclictest1051-21snmpd23:48:082
32890799108,1cyclictest1051-21snmpd22:14:142
32890799108,1cyclictest1051-21snmpd20:28:502
32890799108,1cyclictest1051-21snmpd00:35:432
32890799106,1cyclictest0-21swapper/223:08:492
32890799100,9cyclictest0-21swapper/200:26:162
32890799100,10cyclictest0-21swapper/223:57:332
32890799100,10cyclictest0-21swapper/221:36:022
32890399108,2cyclictest1051-21snmpd23:04:051
32890399108,2cyclictest1051-21snmpd00:07:581
32890399108,1cyclictest1051-21snmpd21:06:421
32890399108,1cyclictest1051-21snmpd21:06:411
32890399108,1cyclictest1045-21nmbd23:38:211
32890399107,2cyclictest347472-21cpuspeed_turbos19:55:171
32890399100,1cyclictest0-21swapper/123:32:261
32890399100,1cyclictest0-21swapper/121:39:381
32890399100,10cyclictest0-21swapper/123:28:031
32890399100,10cyclictest0-21swapper/123:06:581
32890399100,10cyclictest0-21swapper/122:20:541
32890399100,10cyclictest0-21swapper/122:14:231
32890399100,10cyclictest0-21swapper/121:52:321
32890399100,10cyclictest0-21swapper/121:21:281
32890399100,10cyclictest0-21swapper/121:11:281
32890399100,10cyclictest0-21swapper/120:05:311
32890399100,10cyclictest0-21swapper/119:30:151
32890399100,10cyclictest0-21swapper/119:27:421
32890399100,10cyclictest0-21swapper/119:23:511
32890199109,1cyclictest1051-21snmpd23:54:580
32890199108,1cyclictest1550-21ntpd22:41:350
32890199100,9cyclictest0-21swapper/022:45:100
32890199100,10cyclictest0-21swapper/022:06:330
32890199100,10cyclictest0-21swapper/021:26:130
32890199100,10cyclictest0-21swapper/019:48:490
32890199100,10cyclictest0-21swapper/019:36:300
32890199100,10cyclictest0-21swapper/019:27:510
32890199100,10cyclictest0-21swapper/000:31:020
32890199100,10cyclictest0-21swapper/000:09:070
3289099996,2cyclictest1045-21nmbd20:22:203
3289099995,4cyclictest0-21swapper/322:35:423
3289099995,4cyclictest0-21swapper/320:12:223
3289099994,4cyclictest0-21swapper/321:35:023
3289099990,9cyclictest0-21swapper/320:01:403
3289099990,9cyclictest0-21swapper/319:15:003
3289099990,3cyclictest0-21swapper/321:33:563
3289079990,9cyclictest0-21swapper/219:25:162
3289039997,1cyclictest1051-21snmpd20:55:231
3289039996,2cyclictest1051-21snmpd22:29:301
3289039990,9cyclictest0-21swapper/122:03:061
3289039990,9cyclictest0-21swapper/100:12:001
3289019990,1cyclictest0-21swapper/023:15:200
3289099984,4cyclictest0-21swapper/322:12:533
3289039987,1cyclictest1051-21snmpd23:13:111
3289039986,1cyclictest1051-21snmpd20:16:411
3289039986,1cyclictest1051-21snmpd19:54:431
3289039985,2cyclictest1051-21snmpd00:19:441
3289039970,7cyclictest0-21swapper/119:14:451
3289019976,1cyclictest1051-21snmpd22:03:530
3289019975,1cyclictest1051-21snmpd19:30:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional