You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 06:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Jan 07, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1466499895,77cyclictest1811-21grep22:47:023
14663998918,65cyclictest1419-21runrttasks22:06:442
1466399866,73cyclictest0-21swapper/223:34:122
248599850,5rtkit-daemon28556-21yum-updatesd-he21:27:240
1466499854,74cyclictest3586-21runrttasks22:51:503
1466499854,74cyclictest0-21swapper/320:51:533
1466499852,75cyclictest0-21swapper/322:16:583
1466499844,73cyclictest2042-21sed20:32:093
1466399842,51cyclictest0-21swapper/222:01:462
1466499834,72cyclictest0-21swapper/320:56:483
1466399824,56cyclictest0-21swapper/222:31:512
1466399824,11cyclictest783-21unixbench-2d19:22:112
1466399823,72cyclictest0-21swapper/219:41:512
248599810,6rtkit-daemon0-21swapper/100:12:400
1466499814,67cyclictest1419-21runrttasks23:42:353
1466499813,71cyclictest27532-21fschecks_time19:11:573
1466399814,71cyclictest0-21swapper/219:08:182
1466399813,9cyclictest14558-21wc19:51:582
1466499804,70cyclictest0-21swapper/320:26:533
1466499804,69cyclictest1419-21runrttasks23:57:253
1466499802,11cyclictest0-21swapper/320:03:343
1466399807,64cyclictest1419-21runrttasks20:40:532
1466399804,69cyclictest0-21swapper/221:22:042
14663998016,42cyclictest14881-21munin-node18:46:522
1466499795,68cyclictest0-21swapper/323:14:263
1466499794,70cyclictest0-21swapper/320:16:473
1466399795,67cyclictest29359-21sort21:31:482
1466399795,64cyclictest17622-21grep18:51:542
1466399794,68cyclictest0-21swapper/221:46:472
14663997916,48cyclictest0-21swapper/219:26:582
248599780,6rtkit-daemon0-21swapper/123:22:490
248599780,6rtkit-daemon0-21swapper/123:22:490
1466499784,43cyclictest0-21swapper/323:01:483
1466499783,70cyclictest0-21swapper/323:52:003
1466499783,11cyclictest31779-21cpu19:21:523
1466499783,11cyclictest28173-21cpuspeed_turbos22:36:463
1466499783,11cyclictest28173-21cpuspeed_turbos22:36:463
1466399785,64cyclictest4941-21grep19:31:582
1466399784,59cyclictest0-21swapper/220:21:582
1466399784,59cyclictest0-21swapper/220:21:582
1466399783,11cyclictest26294-21tune2fs20:16:542
1466499778,64cyclictest3796-21awk21:46:333
1466499774,8cyclictest8304-21taskset00:09:033
1466499774,8cyclictest8304-21taskset00:09:033
1466499774,10cyclictest21953-21needreboot22:21:583
1466399774,67cyclictest0-21swapper/223:51:292
248599760,6rtkit-daemon8132-21users00:07:020
248599760,6rtkit-daemon8132-21users00:07:020
248599760,6rtkit-daemon32164-21yum-updatesd-he20:27:260
1466499765,60cyclictest4952-21runrttasks20:40:533
1466499764,12cyclictest0-21swapper/321:30:013
1466499764,11cyclictest10833-21chrt22:00:103
1466499763,9cyclictest31277-21if_eth022:41:523
1466499763,9cyclictest18124-21munin-run22:16:323
1466499763,66cyclictest0-21swapper/323:24:403
1466499763,66cyclictest0-21swapper/323:24:403
1466399767,60cyclictest1419-21runrttasks20:42:102
1466399766,60cyclictest1419-21runrttasks19:38:512
1466399766,60cyclictest1419-21runrttasks19:38:512
1466399765,55cyclictest0-21swapper/220:13:392
1466399764,56cyclictest0-21swapper/220:31:482
1466399764,55cyclictest0-21swapper/223:21:312
1466399763,9cyclictest1200-21basename23:56:282
1466399762,8cyclictest16592-21df_abs19:56:532
248599750,6rtkit-daemon3498-21yum-updatesd-he19:27:210
248599750,6rtkit-daemon0-21swapper/121:11:540
248599750,11rtkit-daemon0-21swapper/123:27:190
1466499755,61cyclictest7029-21users20:42:103
1466499754,62cyclictest24702-21cpuspeed_turbos21:21:463
1466499754,10cyclictest23405-21switchtime23:32:013
1466499753,66cyclictest0-21swapper/322:31:513
1466499753,65cyclictest16040-21munin-node19:57:013
1466499753,65cyclictest0-21swapper/320:22:043
1466499753,65cyclictest0-21swapper/320:22:043
1466499753,44cyclictest0-21swapper/322:31:043
1466499752,9cyclictest0-21swapper/321:01:483
1466499752,9cyclictest0-21swapper/321:01:483
1466399758,57cyclictest1419-21runrttasks22:42:022
1466399756,59cyclictest1419-21runrttasks18:56:472
1466399756,59cyclictest1419-21runrttasks18:56:472
1466399755,64cyclictest0-21swapper/222:27:212
1466399755,63cyclictest21968-21taskset21:16:402
1466399754,9cyclictest13768-21processes20:57:052
1466399754,60cyclictest0-21swapper/220:51:532
1466399754,50cyclictest0-21swapper/222:16:522
1466399753,10cyclictest1419-21runrttasks20:28:482
1466399752,9cyclictest0-21swapper/222:13:582
14663997519,39cyclictest13778-21python23:12:012
248599740,7rtkit-daemon0-21swapper/123:50:330
248599740,5rtkit-daemon22090-21ntp_states20:07:040
1466499746,59cyclictest4021-21runrttasks21:46:423
1466499743,64cyclictest0-21swapper/323:06:483
1466499743,60cyclictest21967-21sshd21:16:403
1466499742,10cyclictest3018-21proc_pri19:27:073
1466499742,10cyclictest0-21swapper/319:54:023
1466399747,57cyclictest1419-21runrttasks23:24:102
1466399747,57cyclictest1419-21runrttasks23:24:102
1466399746,59cyclictest1419-21runrttasks19:47:382
1466399746,59cyclictest11384-21mailstats23:07:002
1466399746,58cyclictest1419-21runrttasks19:04:372
1466399745,48cyclictest0-21swapper/221:11:462
1466399744,8cyclictest26776-21runrttasks21:26:462
1466399744,65cyclictest0-21swapper/222:51:422
1466399744,64cyclictest0-21swapper/221:42:052
1466399744,64cyclictest0-21swapper/220:46:532
1466399744,63cyclictest27500-21grep23:41:482
1466399743,8cyclictest121850irq/46-eth022:46:442
14663997414,39cyclictest0-21swapper/223:56:502
248599730,7rtkit-daemon0-21swapper/123:36:190
248599730,6rtkit-daemon0-21swapper/123:59:330
248599730,6rtkit-daemon0-21swapper/123:42:560
248599730,6rtkit-daemon0-21swapper/122:39:360
248599730,6rtkit-daemon0-21swapper/122:39:360
248599730,6rtkit-daemon0-21swapper/119:58:200
248599730,6rtkit-daemon0-21swapper/119:46:350
248599730,6rtkit-daemon0-21swapper/119:12:590
248599730,5rtkit-daemon19003-21diskstats20:01:570
248599730,5rtkit-daemon0-21swapper/023:26:491
1466499736,56cyclictest19658-21runrttasks18:56:473
1466499736,56cyclictest19658-21runrttasks18:56:473
1466499734,60cyclictest14727-21runrttasks23:16:403
1466499733,9cyclictest24103-21hostname20:11:573
1466499733,9cyclictest12074-21tail19:46:583
1466399737,56cyclictest1419-21runrttasks21:09:342
1466399736,59cyclictest1419-21runrttasks22:22:522
1466399736,58cyclictest1419-21runrttasks00:08:062
1466399736,58cyclictest1419-21runrttasks00:08:062
1466399736,57cyclictest1419-21runrttasks19:16:422
1466399735,62cyclictest0-21swapper/221:37:012
1466399735,59cyclictest1419-21runrttasks19:15:292
1466399735,46cyclictest0-21swapper/221:53:552
1466399735,46cyclictest0-21swapper/221:53:552
1466399734,9cyclictest0-21swapper/220:05:502
1466399734,63cyclictest0-21swapper/223:03:132
1466399734,61cyclictest6386-21strings22:56:562
1466399734,61cyclictest25987-21grep23:37:022
1466399734,48cyclictest0-21swapper/200:01:442
1466399733,47cyclictest20812-21munin-node20:06:582
248599720,7rtkit-daemon0-21swapper/122:57:050
248599720,7rtkit-daemon0-21swapper/121:46:450
248599720,7rtkit-daemon0-21swapper/119:06:520
248599720,6rtkit-daemon11227-21ntp_states23:06:570
248599720,6rtkit-daemon0-21swapper/122:45:430
248599720,6rtkit-daemon0-21swapper/122:35:510
248599720,6rtkit-daemon0-21swapper/122:01:520
248599720,6rtkit-daemon0-21swapper/121:58:370
248599720,6rtkit-daemon0-21swapper/121:43:300
248599720,6rtkit-daemon0-21swapper/121:36:380
248599720,6rtkit-daemon0-21swapper/100:03:550
248599720,5rtkit-daemon24088-21smartctl20:11:570
248599720,5rtkit-daemon0-21swapper/123:41:030
248599720,4rtkit-daemon0-21swapper/121:07:470
1466499728,57cyclictest9916-21kernelversion19:42:033
1466499725,61cyclictest0-21swapper/318:56:403
1466499725,59cyclictest21833-21munin-node20:07:003
1466499725,58cyclictest31211-21runrttasks23:51:133
1466499724,63cyclictest0-21swapper/321:51:493
1466499724,63cyclictest0-21swapper/321:51:493
1466499724,62cyclictest0-21swapper/319:08:123
1466499724,61cyclictest8411-21runrttasks19:38:513
1466499724,61cyclictest8411-21runrttasks19:38:513
1466499724,61cyclictest15632-21runrttasks22:10:193
1466499724,59cyclictest9578-21cut00:11:493
1466499723,63cyclictest0-21swapper/323:36:433
1466499723,13cyclictest0-21swapper/322:01:513
1466499723,10cyclictest17306-21aten_r1power_po21:06:473
1466499723,10cyclictest0-21swapper/322:56:443
14664997214,52cyclictest4088-21aten_r1power_cu19:31:493
1466399724,57cyclictest9439-21grep21:56:512
248599710,6rtkit-daemon7301-21sh21:51:530
248599710,6rtkit-daemon7301-21sh21:51:530
248599710,6rtkit-daemon12424-21aten2.4-expect23:11:420
248599710,6rtkit-daemon0-21swapper/122:13:220
248599710,6rtkit-daemon0-21swapper/121:32:160
248599710,6rtkit-daemon0-21swapper/121:16:470
248599710,6rtkit-daemon0-21swapper/120:57:020
248599710,6rtkit-daemon0-21swapper/120:48:180
248599710,6rtkit-daemon0-21swapper/120:25:340
248599710,6rtkit-daemon0-21swapper/120:25:340
248599710,6rtkit-daemon0-21swapper/119:53:500
248599710,6rtkit-daemon0-21swapper/119:50:500
248599710,6rtkit-daemon0-21swapper/119:24:580
248599710,6rtkit-daemon0-21swapper/119:02:590
248599710,5rtkit-daemon2792-21munin-node22:51:430
248599710,5rtkit-daemon27480-21sshd20:18:260
248599710,5rtkit-daemon19692-21ps22:16:590
1466499715,57cyclictest5858-21runrttasks00:03:183
1466499715,56cyclictest22404-21cpuspeed_turbos19:01:563
1466499714,61cyclictest0-21swapper/321:11:553
1466499714,58cyclictest29191-21runrttasks19:16:423
1466499713,9cyclictest29259-21tail21:31:473
1466499713,10cyclictest8941-21awk20:47:043
1466499712,10cyclictest0-21swapper/318:48:243
1466399715,58cyclictest1419-21runrttasks00:14:312
1466399714,59cyclictest28277-21runrttasks22:36:472
1466399714,59cyclictest28277-21runrttasks22:36:472
14663997120,45cyclictest0-21swapper/223:26:582
248599700,6rtkit-daemon31105-21chrt19:18:290
248599700,6rtkit-daemon0-21swapper/123:54:550
248599700,6rtkit-daemon0-21swapper/123:18:270
248599700,6rtkit-daemon0-21swapper/122:48:130
248599700,6rtkit-daemon0-21swapper/122:21:590
248599700,6rtkit-daemon0-21swapper/122:07:070
248599700,6rtkit-daemon0-21swapper/121:02:550
248599700,6rtkit-daemon0-21swapper/121:02:550
248599700,6rtkit-daemon0-21swapper/120:51:480
1466499704,59cyclictest31804-21grep21:36:493
1466399705,56cyclictest1419-21runrttasks21:01:532
1466399705,56cyclictest1419-21runrttasks21:01:532
248599690,7rtkit-daemon0-21swapper/022:41:431
248599690,6rtkit-daemon0-21swapper/121:22:460
248599690,6rtkit-daemon0-21swapper/022:56:581
1466499697,56cyclictest1676-21nscd23:31:293
1466499694,59cyclictest0-21swapper/318:46:413
248599680,7rtkit-daemon0-21swapper/021:51:451
248599680,7rtkit-daemon0-21swapper/021:51:451
248599680,6rtkit-daemon0-21swapper/119:31:580
248599680,6rtkit-daemon0-21swapper/019:57:051
248599670,6rtkit-daemon14482-21grep19:51:571
248599670,6rtkit-daemon0-21swapper/023:42:111
248599670,6rtkit-daemon0-21swapper/000:01:551
248599670,5rtkit-daemon0-21swapper/122:26:360
248599660,6rtkit-daemon4877-21sed21:46:531
248599650,7rtkit-daemon0-21swapper/023:31:411
248599650,7rtkit-daemon0-21swapper/022:14:441
248599650,7rtkit-daemon0-21swapper/021:11:471
248599650,7rtkit-daemon0-21swapper/000:07:171
248599650,7rtkit-daemon0-21swapper/000:07:171
248599640,8rtkit-daemon0-21swapper/020:12:041
248599640,7rtkit-daemon9331-21cut00:11:471
248599640,5rtkit-daemon0-21swapper/023:08:051
1466399645,53cyclictest0-21swapper/218:46:412
248599630,7rtkit-daemon0-21swapper/020:23:261
248599630,7rtkit-daemon0-21swapper/020:23:261
248599630,6rtkit-daemon26946-21aten_r1power_po19:11:511
248599630,6rtkit-daemon0-21swapper/022:16:521
248599630,6rtkit-daemon0-21swapper/020:02:041
14662996336,9cyclictest13272-21tail20:56:561
324202563,10sleep10-21swapper/121:36:561
14662995515,24cyclictest2956-21proc_pri21:42:011
14657995511,8cyclictest433-21telnet20:31:490
1466299545,32cyclictest0-21swapper/120:32:021
14662995421,12cyclictest0-21swapper/122:06:591
1466299534,33cyclictest0-21swapper/121:26:551
14662995320,15cyclictest0-21swapper/119:06:411
88512523,42sleep10-21swapper/119:41:431
264832523,11sleep10-21swapper/119:10:281
158372524,41sleep115928-21load21:01:591
158372524,41sleep115928-21load21:01:591
1466299525,29cyclictest0-21swapper/123:46:461
1466299525,27cyclictest0-21swapper/123:17:041
1466299524,30cyclictest0-21swapper/123:06:301
1466299524,29cyclictest0-21swapper/121:07:111
1466299524,28cyclictest0-21swapper/123:11:531
14662995235,9cyclictest20470-21head18:57:001
14662995235,9cyclictest20470-21head18:57:001
14662995235,10cyclictest26502-21crond21:26:341
14662995221,13cyclictest0-21swapper/123:57:001
14662995215,33cyclictest20893-21aten_r1power_vo22:21:451
123642523,10sleep10-21swapper/122:01:591
255132513,42sleep125514-21munin-node22:31:451
1466299515,27cyclictest0-21swapper/120:48:451
1466299515,27cyclictest0-21swapper/120:21:371
1466299515,26cyclictest0-21swapper/120:46:351
1466299514,29cyclictest0-21swapper/122:29:011
1466299514,28cyclictest0-21swapper/122:51:521
1466299514,28cyclictest0-21swapper/121:31:461
1466299514,27cyclictest15567-21fschecks_count18:46:591
1466299514,27cyclictest0-21swapper/119:16:541
1466299514,26cyclictest0-21swapper/118:56:411
14662995121,11cyclictest0-21swapper/123:22:051
14662995121,11cyclictest0-21swapper/123:22:051
14662995111,23cyclictest32561-21if_eth019:22:001
14657995134,10cyclictest9268-21sed23:02:030
46512503,41sleep14671-21fschecks_count19:31:561
1466299505,27cyclictest0-21swapper/122:36:491
1466299505,27cyclictest0-21swapper/122:36:491
1466299505,27cyclictest0-21swapper/121:56:481
1466299505,27cyclictest0-21swapper/120:56:361
1466299505,26cyclictest0-21swapper/120:28:421
1466299504,28cyclictest0-21swapper/119:36:591
1466299504,28cyclictest0-21swapper/119:36:591
1466299504,26cyclictest1287-21snmpd19:47:101
14662995017,13cyclictest0-21swapper/120:36:551
14662994932,10cyclictest32301-21head23:51:491
14662994919,10cyclictest24803-21df_abs23:36:431
14657994921,13cyclictest0-21swapper/018:57:370
14657994921,13cyclictest0-21swapper/018:57:370
14657994920,12cyclictest0-21swapper/018:51:400
1466299484,18cyclictest0-21swapper/120:06:501
1466299483,27cyclictest0-21swapper/122:46:481
14662994719,10cyclictest1247-21lldpd21:18:221
14657994710,21cyclictest0-21swapper/019:41:380
14657994710,21cyclictest0-21swapper/019:41:380
1465799463,27cyclictest0-21swapper/020:36:540
14657994621,11cyclictest0-21swapper/020:46:370
14657994618,12cyclictest0-21swapper/018:52:150
1466299455,32cyclictest0-21swapper/119:26:551
124712453,35sleep00-21swapper/018:41:470
1466299433,19cyclictest14638-21latency_hist18:46:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional