You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 01:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sat Jul 19, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2230991150,7rtkit-daemon0-21swapper/018:37:041
2230991150,7rtkit-daemon0-21swapper/018:37:041
223099940,6rtkit-daemon0-21swapper/018:50:260
223099940,5rtkit-daemon0-21swapper/319:41:543
27364998269,8cyclictest38602sleep023:05:560
27364998130,43cyclictest1265-21runrttasks19:30:420
216522810,2sleep1201ktimersoftd/119:15:451
27364997922,50cyclictest0-21swapper/020:05:440
27364997922,50cyclictest0-21swapper/020:05:440
27364997526,42cyclictest21572-21chrt19:15:440
27364997525,43cyclictest0-21swapper/018:21:100
223099750,7rtkit-daemon0-21swapper/019:01:480
27364997425,41cyclictest0-21swapper/021:11:000
27364997323,43cyclictest0-21swapper/023:05:230
27364997323,43cyclictest0-21swapper/023:05:230
223099730,7rtkit-daemon0-21swapper/119:01:331
27364997230,35cyclictest18968-21latency22:30:480
27364997225,40cyclictest0-21swapper/023:19:100
27364997224,41cyclictest0-21swapper/020:16:020
27364997224,40cyclictest0-21swapper/021:00:410
27364997135,29cyclictest10424-21grep23:20:440
27364997131,13cyclictest6884-21yum-updatesd-he23:15:230
27364997130,35cyclictest26331-21taskset21:40:400
27364997130,34cyclictest27182-21munin-run22:50:220
27364997124,39cyclictest0-21swapper/020:55:410
27364997118,37cyclictest0-21swapper/020:40:550
223099710,9rtkit-daemon0-21swapper/321:35:353
27364997031,33cyclictest1265-21runrttasks22:55:420
27364997026,38cyclictest30806-21idleruntime-cro21:50:250
27364997026,38cyclictest0-21swapper/021:06:000
27364997025,37cyclictest27267-21munin-run20:35:270
27364997024,39cyclictest0-21swapper/023:48:310
27364997024,39cyclictest0-21swapper/023:48:310
223099700,6rtkit-daemon0-21swapper/018:30:570
27364996925,37cyclictest0-21swapper/019:40:310
27364996924,37cyclictest0-21swapper/018:55:430
27364996924,31cyclictest0-21swapper/020:22:450
27364996923,39cyclictest0-21swapper/019:45:590
27364996919,43cyclictest0-21swapper/023:25:320
27364996827,35cyclictest19035-21munin-node23:40:480
27364996827,35cyclictest0-21swapper/021:15:390
27364996826,35cyclictest28359-21basename22:50:440
27364996826,35cyclictest26036-21munin-run21:40:250
27364996825,36cyclictest0-21swapper/021:50:380
223099680,6rtkit-daemon0-21swapper/319:41:092
27364996729,32cyclictest6001-21missed_timers18:40:570
27364996726,34cyclictest0-21swapper/021:20:560
70912663,54sleep30-21swapper/323:15:263
27364996632,28cyclictest32718-21df20:45:450
27364996629,31cyclictest26485-21aten_r1power_vo19:25:420
27364996623,37cyclictest0-21swapper/021:30:450
27364996623,37cyclictest0-21swapper/021:30:450
27364996616,42cyclictest0-21swapper/023:36:400
223099660,8rtkit-daemon0-21swapper/119:33:171
223099660,8rtkit-daemon0-21swapper/118:34:491
223099660,7rtkit-daemon0-21swapper/123:44:151
223099660,7rtkit-daemon0-21swapper/018:55:110
27364996544,15cyclictest0-21swapper/022:40:520
27364996539,18cyclictest1265-21runrttasks20:01:450
27364996532,27cyclictest1265-21runrttasks19:57:020
27364996532,26cyclictest12278-21timerandwakeup22:15:570
27364996532,26cyclictest12278-21timerandwakeup22:15:570
27364996531,27cyclictest2743-21cpuspeed_turbos20:50:400
27364996531,27cyclictest2743-21cpuspeed_turbos20:50:400
27364996531,27cyclictest0-21swapper/020:10:510
27364996526,24cyclictest7380-21swap22:05:580
27364996523,12cyclictest2579-21telnet18:35:460
27364996523,12cyclictest2579-21telnet18:35:460
27364996518,41cyclictest0-21swapper/022:00:350
223099650,8rtkit-daemon0-21swapper/119:10:331
223099650,8rtkit-daemon0-21swapper/118:56:331
223099650,8rtkit-daemon0-21swapper/118:47:411
223099650,8rtkit-daemon0-21swapper/118:40:341
223099650,7rtkit-daemon0-21swapper/123:46:221
223099650,7rtkit-daemon0-21swapper/123:46:221
223099650,7rtkit-daemon0-21swapper/119:29:021
223099650,7rtkit-daemon0-21swapper/119:20:471
223099650,7rtkit-daemon0-21swapper/119:07:111
223099650,7rtkit-daemon0-21swapper/118:51:561
223099650,7rtkit-daemon0-21swapper/118:30:040
223099650,7rtkit-daemon0-21swapper/019:21:320
223099650,7rtkit-daemon0-21swapper/019:11:180
223099650,7rtkit-daemon0-21swapper/019:06:260
27364996434,25cyclictest0-21swapper/019:41:560
27364996430,28cyclictest9105-21gltestperf22:10:430
27364996426,32cyclictest0-21swapper/020:36:000
27364996330,27cyclictest13695-21cut22:20:390
27364996319,38cyclictest0-21swapper/021:25:360
223099620,9rtkit-daemon0-21swapper/322:41:253
223099620,9rtkit-daemon0-21swapper/320:36:593
223099620,8rtkit-daemon0-21swapper/323:21:463
223099620,8rtkit-daemon0-21swapper/320:29:153
223099620,8rtkit-daemon0-21swapper/319:58:463
223099620,7rtkit-daemon0-21swapper/320:13:153
223099620,3rtkit-daemon0-21swapper/322:26:333
223099620,10rtkit-daemon0-21swapper/323:02:393
223099620,10rtkit-daemon0-21swapper/323:02:393
223099620,10rtkit-daemon0-21swapper/321:54:343
2736899615,40cyclictest0-21swapper/318:21:033
27368996118,29cyclictest0-21swapper/322:10:363
27364996120,15cyclictest0-21swapper/022:25:360
27364996119,36cyclictest0-21swapper/019:50:430
27364996116,39cyclictest0-21swapper/021:55:370
223099610,9rtkit-daemon0-21swapper/323:07:313
223099610,9rtkit-daemon0-21swapper/322:49:323
223099610,9rtkit-daemon0-21swapper/322:17:413
223099610,9rtkit-daemon0-21swapper/322:17:413
223099610,9rtkit-daemon0-21swapper/321:56:043
223099610,9rtkit-daemon0-21swapper/321:32:053
223099610,9rtkit-daemon0-21swapper/321:32:053
223099610,9rtkit-daemon0-21swapper/320:55:363
223099610,9rtkit-daemon0-21swapper/320:42:143
223099610,9rtkit-daemon0-21swapper/320:31:453
223099610,9rtkit-daemon0-21swapper/320:15:303
223099610,8rtkit-daemon0-21swapper/321:07:583
223099610,8rtkit-daemon0-21swapper/320:02:383
223099610,7rtkit-daemon0-21swapper/321:44:273
223099610,4rtkit-daemon0-21swapper/319:46:543
223099610,11rtkit-daemon0-21swapper/322:06:413
223099610,11rtkit-daemon0-21swapper/321:18:053
223099610,10rtkit-daemon0-21swapper/322:31:183
223099610,10rtkit-daemon0-21swapper/320:23:383
223099610,10rtkit-daemon0-21swapper/320:10:013
223099610,10rtkit-daemon0-21swapper/320:10:013
46002603,49sleep24605-21turbostat.cron18:40:322
46002603,49sleep24605-21turbostat.cron18:40:322
27364996036,17cyclictest1265-21runrttasks20:30:270
27364996019,34cyclictest0-21swapper/023:30:350
27364996015,39cyclictest0-21swapper/022:35:490
223099600,8rtkit-daemon0-21swapper/323:14:013
223099600,8rtkit-daemon0-21swapper/322:38:023
223099600,8rtkit-daemon0-21swapper/321:23:353
223099600,8rtkit-daemon0-21swapper/320:47:293
223099600,8rtkit-daemon0-21swapper/319:54:163
223099600,7rtkit-daemon0-21swapper/322:50:323
223099600,7rtkit-daemon0-21swapper/322:20:553
223099600,7rtkit-daemon0-21swapper/321:47:273
223099600,7rtkit-daemon0-21swapper/320:51:513
223099600,7rtkit-daemon0-21swapper/320:51:513
223099600,11rtkit-daemon0-21swapper/321:26:583
223099600,10rtkit-daemon0-21swapper/322:56:023
223099600,10rtkit-daemon0-21swapper/322:01:413
223099600,10rtkit-daemon0-21swapper/321:02:213
78782594,47sleep10-21swapper/121:00:461
2736799593,38cyclictest0-21swapper/219:30:422
223099590,7rtkit-daemon0-21swapper/321:10:433
2736899574,38cyclictest0-21swapper/323:37:023
2736699574,46cyclictest0-21swapper/123:40:201
27367995612,17cyclictest14025-21crond23:30:202
2736699564,44cyclictest0-21swapper/123:05:221
2736699564,44cyclictest0-21swapper/123:05:221
27366995635,13cyclictest0-21swapper/122:30:231
2736899545,29cyclictest0-21swapper/323:25:373
2736899545,29cyclictest0-21swapper/318:55:443
2736899544,40cyclictest7919-21fschecks_time18:45:523
27366995434,13cyclictest0-21swapper/123:25:521
27366995434,13cyclictest0-21swapper/122:05:241
27366995424,12cyclictest0-21swapper/122:30:511
244502543,44sleep124545-21fschecks_count21:35:411
223099540,5rtkit-daemon2229-21rtkit-daemon23:35:452
68642532,44sleep10-21swapper/120:59:501
286822533,42sleep20-21swapper/222:50:512
2736899535,29cyclictest0-21swapper/319:00:583
2736899534,41cyclictest0-21swapper/319:05:533
2736899534,29cyclictest0-21swapper/318:35:473
2736899534,29cyclictest0-21swapper/318:35:473
27368995321,13cyclictest0-21swapper/323:45:353
27368995321,13cyclictest0-21swapper/323:45:353
27368995320,13cyclictest21349-21yum-updatesd-he19:15:463
2736799534,30cyclictest0-21swapper/218:31:012
2736799533,44cyclictest0-21swapper/223:09:532
2736699534,40cyclictest0-21swapper/123:15:391
27366995316,29cyclictest0-21swapper/120:00:291
223099530,5rtkit-daemon2229-21rtkit-daemon23:30:532
127092532,9sleep20-21swapper/220:02:512
68422522,9sleep30-21swapper/318:43:393
299702523,42sleep330050-21munin-node18:25:463
2736899524,29cyclictest0-21swapper/319:20:473
2736899524,28cyclictest0-21swapper/323:32:333
2736899523,31cyclictest0-21swapper/319:25:413
27367995218,12cyclictest0-21swapper/220:56:022
27366995233,12cyclictest0-21swapper/120:52:421
27366995233,12cyclictest0-21swapper/120:52:421
27366995232,11cyclictest10339-21gltestperf21:05:451
27364995224,11cyclictest7150irq/45-ahci18:20:330
2736899514,28cyclictest0-21swapper/318:31:083
2736899514,27cyclictest0-21swapper/323:45:213
2736799514,21cyclictest0-21swapper/223:40:452
2736799513,29cyclictest0-21swapper/221:15:262
2736699513,29cyclictest0-21swapper/120:15:411
299562502,40sleep10-21swapper/118:25:351
2736899504,27cyclictest0-21swapper/318:55:323
27368995032,11cyclictest19281-21aten_r1power_po19:10:443
2736799504,38cyclictest0-21swapper/220:10:512
2736799504,30cyclictest0-21swapper/223:20:512
2736799504,28cyclictest0-21swapper/223:15:232
2736799504,28cyclictest0-21swapper/221:15:362
2736799504,28cyclictest0-21swapper/219:15:452
27367995034,10cyclictest9888-21taskset21:05:402
27367995021,12cyclictest0-21swapper/221:35:392
2736699504,28cyclictest0-21swapper/118:21:001
2736699504,27cyclictest0-21swapper/121:50:571
27366995031,11cyclictest32462-21cpu20:45:431
27366995017,13cyclictest0-21swapper/120:01:451
251812505,36sleep225016-21yum-updatesd-he18:15:422
233342502,9sleep20-21swapper/221:31:312
233342502,9sleep20-21swapper/221:31:312
222542502,41sleep10-21swapper/122:38:331
91602492,6sleep21160-21snmpd21:03:382
46952493,10sleep20-21swapper/222:00:492
2736899494,27cyclictest0-21swapper/319:31:073
2736799496,26cyclictest0-21swapper/218:20:572
2736799495,27cyclictest0-21swapper/221:40:482
2736799494,27cyclictest0-21swapper/222:20:382
2736799494,27cyclictest0-21swapper/220:51:012
2736799494,27cyclictest0-21swapper/220:51:012
2736799494,27cyclictest0-21swapper/220:40:392
2736799494,27cyclictest0-21swapper/220:26:012
2736799494,27cyclictest0-21swapper/218:50:522
27367994934,9cyclictest27172-21crond22:50:222
2736799492,34cyclictest0-21swapper/221:51:422
2736799492,34cyclictest0-21swapper/219:55:542
27367994919,12cyclictest0-21swapper/219:51:062
2736699495,36cyclictest0-21swapper/121:15:381
2736699494,36cyclictest1265-21runrttasks22:55:401
2736699493,40cyclictest0-21swapper/121:55:271
27366994919,12cyclictest0-21swapper/122:10:471
27366994918,13cyclictest0-21swapper/120:31:001
255482493,40sleep20-21swapper/219:21:032
235232493,40sleep123626-21http_loadtime20:25:481
282852482,9sleep20-21swapper/219:27:482
2736799487,23cyclictest0-21swapper/218:59:232
2736799485,26cyclictest0-21swapper/220:20:572
2736799484,27cyclictest0-21swapper/222:25:512
2736799484,27cyclictest0-21swapper/222:15:342
2736799484,27cyclictest0-21swapper/222:15:342
2736799484,27cyclictest0-21swapper/220:45:592
2736799484,27cyclictest0-21swapper/220:30:562
2736799484,27cyclictest0-21swapper/220:05:432
2736799484,27cyclictest0-21swapper/220:05:432
2736799484,24cyclictest0-21swapper/219:45:462
2736799483,26cyclictest0-21swapper/220:20:282
2736699484,27cyclictest0-21swapper/123:20:361
27366994833,9cyclictest28022-21cut22:50:411
27366994833,10cyclictest0-21swapper/122:42:241
27366994828,13cyclictest0-21swapper/122:15:371
27366994828,13cyclictest0-21swapper/122:15:371
31012472,9sleep20-21swapper/221:58:032
2736799474,36cyclictest0-21swapper/222:40:562
2736799474,27cyclictest0-21swapper/222:55:352
2736799474,27cyclictest0-21swapper/222:10:502
2736799473,27cyclictest0-21swapper/218:41:022
2736699478,33cyclictest0-21swapper/120:20:591
2736699474,37cyclictest0-21swapper/123:30:411
2736699474,36cyclictest0-21swapper/119:45:581
2736699474,35cyclictest0-21swapper/120:35:451
2736699474,26cyclictest0-21swapper/123:10:331
2736699473,38cyclictest0-21swapper/120:15:281
27366994729,11cyclictest23160-21unixbench-2d21:31:001
27366994729,11cyclictest23160-21unixbench-2d21:31:001
27366994728,12cyclictest0-21swapper/120:44:321
220792472,9sleep20-21swapper/222:36:162
91512462,9sleep20-21swapper/218:47:372
89172462,9sleep20-21swapper/223:16:022
2736799465,23cyclictest0-21swapper/219:00:442
2736799464,36cyclictest31390-21find18:26:032
2736799464,26cyclictest0-21swapper/221:25:382
2736799464,25cyclictest0-21swapper/223:45:402
2736799464,25cyclictest0-21swapper/223:45:402
2736799464,25cyclictest0-21swapper/219:37:292
2736799463,26cyclictest0-21swapper/222:30:362
2736799463,25cyclictest0-21swapper/221:22:462
2736799463,25cyclictest0-21swapper/219:11:202
2736699465,35cyclictest0-21swapper/119:40:301
2736699464,26cyclictest0-21swapper/121:27:471
2736699463,39cyclictest0-21swapper/121:12:001
2736699463,38cyclictest0-21swapper/120:07:261
2736699463,38cyclictest0-21swapper/120:07:261
2736699463,36cyclictest0-21swapper/122:05:391
24562463,37sleep10-21swapper/119:40:571
2736799453,26cyclictest0-21swapper/223:00:462
2736799453,26cyclictest0-21swapper/223:00:462
2736799453,26cyclictest0-21swapper/222:06:002
2736799452,31cyclictest0-21swapper/219:05:522
27367994518,12cyclictest0-21swapper/221:45:402
2736699454,34cyclictest0-21swapper/119:50:461
2736699454,14cyclictest0-21swapper/122:20:511
2736699453,36cyclictest0-21swapper/123:05:501
27366994529,10cyclictest26716-21unixbench_multi22:45:571
27368994415,14cyclictest0-21swapper/319:35:573
2736799444,22cyclictest0-21swapper/220:35:382
2736699444,12cyclictest0-21swapper/121:20:581
27366994427,11cyclictest26636-21tr21:40:421
2736699433,12cyclictest0-21swapper/121:45:541
2736699424,12cyclictest0-21swapper/118:20:331
2544424010,16sleep30-21swapper/318:15:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional