You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 12:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 09, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450680,0irq/25-eth10-21swapper/318:45:053
811823724,0sleep00-21swapper/018:45:100
808322723,0sleep10-21swapper/118:44:471
800322622,0sleep20-21swapper/218:43:482
83799960,0cyclictest0-21swapper/223:47:522
83799960,0cyclictest0-21swapper/222:39:452
83799960,0cyclictest0-21swapper/221:22:022
83799960,0cyclictest0-21swapper/221:12:252
83789960,0cyclictest0-21swapper/123:31:041
83789960,0cyclictest0-21swapper/123:10:251
83789960,0cyclictest0-21swapper/100:11:071
8215060,0irq/24-0000:00:16007-21idleruntime-cro19:17:252
339960,0migration/331012-21kthreadcore20:37:433
339960,0migration/329536-21fschecks_time22:22:373
339960,0migration/321086-21fschecks_time22:37:383
339960,0migration/310405-21sh22:48:033
29715060,0irq/26-eth0-rx-23120-21grep23:57:413
29715060,0irq/26-eth0-rx-22807-21cut21:17:363
29715060,0irq/26-eth0-rx-17507-21grep19:42:373
149960,0migration/02938-21fschecks_count23:47:370
149960,0migration/027457-21munin-node23:22:360
149960,0migration/021984-21sh20:55:570
149960,0migration/021780-21sh21:15:260
149960,0migration/021406-21kthreadcore19:42:430
149960,0migration/020838-21sh21:55:570
149960,0migration/018130-21sh23:14:120
149960,0migration/017026-21sh23:53:590
149960,0migration/013513-21irqcore20:27:410
83799955,0cyclictest0-21swapper/223:58:262
83799955,0cyclictest0-21swapper/223:16:392
83799955,0cyclictest0-21swapper/222:47:012
83799950,0cyclictest0-21swapper/222:18:472
83799950,0cyclictest0-21swapper/220:35:502
83789955,0cyclictest0-21swapper/123:54:431
83789955,0cyclictest0-21swapper/123:43:031
83789955,0cyclictest0-21swapper/122:15:051
83789955,0cyclictest0-21swapper/121:59:001
83789955,0cyclictest0-21swapper/100:05:171
83789950,0cyclictest0-21swapper/123:04:161
83789950,0cyclictest0-21swapper/120:57:311
8215050,0irq/24-0000:00:30051-21cat21:42:242
339950,0migration/39672-21ksmtuned23:50:493
339950,0migration/39198-21taskset19:10:283
339950,0migration/38887-21kthreadcore22:27:413
339950,0migration/3832-21switchtime23:22:483
339950,0migration/35762-21sh22:07:373
339950,0migration/33627-21munin-node19:52:463
339950,0migration/322301-21fschecks_time21:57:393
339950,0migration/317745-21taskset23:13:033
339950,0migration/317020-21latency_hist19:42:253
339950,0migration/316843-21munin-node23:32:463
339950,0migration/31649-21munin-node19:02:473
339950,0migration/316166-21taskset00:13:093
339950,0migration/315735-21taskset19:14:243
339950,0migration/315307-21kthreadcore22:52:413
339950,0migration/312505-21aten_r1power_cu20:27:363
339950,0migration/310352-21ntp_offset19:57:443
339950,0migration/310352-21ntp_offset19:57:443
29725050,0irq/27-eth0-tx-730-21smartctl23:22:472
29725050,0irq/27-eth0-tx-6163-21ssh21:27:252
29725050,0irq/27-eth0-tx-31648-21grep23:02:402
29725050,0irq/27-eth0-tx-29215-21ssh21:40:292
29725050,0irq/27-eth0-tx-11606-21ssh22:08:462
29725050,0irq/27-eth0-tx-11260-21ntpq21:47:472
29725050,0irq/27-eth0-tx-11003-21ssh23:11:372
29725050,0irq/27-eth0-tx-10612-21ssh23:32:072
29725050,0irq/27-eth0-tx-10154-21ntpdc22:27:432
29725050,0irq/27-eth0-tx-0-21swapper/221:57:382
29725050,0irq/27-eth0-tx-0-21swapper/221:32:472
29725050,0irq/27-eth0-tx-0-21swapper/221:07:392
29725050,0irq/27-eth0-tx-0-21swapper/221:04:212
29725050,0irq/27-eth0-tx-0-21swapper/200:14:442
29725050,0irq/27-eth0-tx-0-21swapper/200:03:592
29725050,0irq/27-eth0-tx-0-21swapper/019:07:120
29715050,0irq/26-eth0-rx-9093-21kthreadcore21:47:443
29715050,0irq/26-eth0-rx-6559-21runrttasks21:52:363
29715050,0irq/26-eth0-rx-4320-21kthreadcore00:07:413
29715050,0irq/26-eth0-rx-26037-21kthreadcore21:37:423
29715050,0irq/26-eth0-rx-22890-21grep20:32:423
29715050,0irq/26-eth0-rx-20623-21grep22:57:363
29715050,0irq/26-eth0-rx-16166-21processes23:52:463
29715050,0irq/26-eth0-rx-0-21swapper/323:42:433
29715050,0irq/26-eth0-rx-0-21swapper/323:18:093
29715050,0irq/26-eth0-rx-0-21swapper/323:07:473
29715050,0irq/26-eth0-rx-0-21swapper/322:42:323
29715050,0irq/26-eth0-rx-0-21swapper/322:35:173
29715050,0irq/26-eth0-rx-0-21swapper/322:12:433
29715050,0irq/26-eth0-rx-0-21swapper/321:26:583
29715050,0irq/26-eth0-rx-0-21swapper/321:14:093
29715050,0irq/26-eth0-rx-0-21swapper/321:05:503
29715050,0irq/26-eth0-rx-0-21swapper/321:01:213
29715050,0irq/26-eth0-rx-0-21swapper/320:02:373
259950,0migration/226974-21aten_r1power_fr23:42:372
259950,0migration/217238-21sh23:33:092
259950,0migration/216233-21kthreadcore21:52:422
259950,0migration/212440-21df_abs22:52:362
249950,0watchdog/224846-21sed23:17:422
19150,0ktimersoftd/10-21swapper/123:02:041
179950,0migration/19223-21fschecks_time18:47:401
179950,0migration/14791-21cpuspeed_turbos22:27:361
179950,0migration/14585-21taskset19:57:001
179950,0migration/128494-21aten_r1power_cu22:42:361
179950,0migration/124004-21timerwakeupswit20:07:481
179950,0migration/119489-21switchtime21:52:471
179950,0migration/111645-21fschecks_time23:32:371
179950,0migration/110619-21sh22:48:431
169950,0watchdog/119536-21grep23:37:381
169950,0watchdog/118531-21tr21:32:421
169950,0watchdog/114806-21cut23:12:421
149950,0migration/09900-21taskset23:08:150
149950,0migration/07313-21fschecks_count20:47:380
149950,0migration/05352-21dump-pmu-power21:47:190
149950,0migration/04680-21latency_hist19:57:250
149950,0migration/03497-21fschecks_time19:07:370
149950,0migration/032737-21cpuspeed_turbos20:42:360
149950,0migration/030405-21kthreadcore22:22:400
149950,0migration/026771-21taskset22:59:300
149950,0migration/024797-21taskset22:17:420
149950,0migration/024519-21kthreadcore19:22:420
149950,0migration/022339-21kthreadcore20:07:420
149950,0migration/021796-21latency_hist18:57:250
149950,0migration/021047-21kthreadcore20:32:410
149950,0migration/019829-21kthreadcore23:57:400
149950,0migration/01879-21munin-node22:42:470
149950,0migration/01782-21kthreadcore20:17:410
149950,0migration/013664-21kthreadcore00:12:420
149950,0migration/013561-21if_eth1.322:32:390
149950,0migration/013317-21kthreadcore19:37:440
149950,0migration/011926-21taskset21:48:050
149950,0migration/011443-21sh22:51:140
149950,0migration/011059-21kthreadcore18:47:430
149950,0migration/010242-21kthreadcore21:07:420
83799943,0cyclictest4851-21awk19:32:402
83799943,0cyclictest3556-21lldpd20:57:352
83799943,0cyclictest3556-21lldpd20:45:352
83799943,0cyclictest3556-21lldpd20:15:332
83799943,0cyclictest3556-21lldpd19:52:332
83799943,0cyclictest3556-21lldpd19:46:022
83799943,0cyclictest3514-21snmpd18:53:412
83799940,0cyclictest0-21swapper/220:27:292
83789944,0cyclictest6600-21diskmemload22:17:361
83789944,0cyclictest0-21swapper/122:08:091
83789943,0cyclictest3514-21snmpd22:53:551
83789943,0cyclictest3514-21snmpd21:02:251
83789943,0cyclictest3514-21snmpd20:36:261
83789943,0cyclictest3514-21snmpd19:22:561
83789943,0cyclictest30966-21awk21:42:381
83789943,0cyclictest24761-21awk19:47:401
83789943,0cyclictest19294-21awk23:57:381
83789943,0cyclictest13514-21awk22:32:391
83779944,0cyclictest0-21swapper/022:16:310
83779943,0cyclictest6721-21awk20:22:410
83779943,0cyclictest4815-21sadc22:07:240
83779943,0cyclictest3514-21snmpd23:38:560
83779943,0cyclictest3514-21snmpd22:00:400
83779943,0cyclictest3514-21snmpd19:01:260
83779943,0cyclictest3241-21irqbalance23:28:220
83779943,0cyclictest27301-21awk00:02:400
83779943,0cyclictest24716-21awk19:47:400
83779943,0cyclictest23604-21awk21:17:400
83779943,0cyclictest17169-21awk19:17:400
83779943,0cyclictest15160-21awk21:32:400
83779943,0cyclictest12971-21awk22:52:380
83779942,0cyclictest4377-21sensors21:02:480
83779940,0cyclictest0-21swapper/020:12:380
83779940,0cyclictest0-21swapper/020:02:500
339940,0migration/331836-21kthreadcore19:27:423
339940,0migration/325316-21diskmemload23:38:243
339940,0migration/322888-21aten_r1power_cu19:22:363
339940,0migration/318558-21kthreadcore19:17:423
339940,0migration/31831-21kthreadcore22:02:443
339940,0migration/310957-21kthreadcore21:27:393
29725040,0irq/27-eth0-tx-8469-21ssh00:08:502
29725040,0irq/27-eth0-tx-7358-21kthreadcore22:47:412
29725040,0irq/27-eth0-tx-0-21swapper/222:57:292
29725040,0irq/27-eth0-tx-0-21swapper/222:32:542
29725040,0irq/27-eth0-tx-0-21swapper/222:22:362
29725040,0irq/27-eth0-tx-0-21swapper/221:22:362
29725040,0irq/27-eth0-tx-0-21swapper/220:52:442
29725040,0irq/27-eth0-tx-0-21swapper/220:49:272
29725040,0irq/27-eth0-tx-0-21swapper/020:41:040
29725040,0irq/27-eth0-tx-0-21swapper/019:57:360
29725040,0irq/27-eth0-tx-0-21swapper/019:57:360
29715040,0irq/26-eth0-rx-14717-21fschecks_count21:32:383
29715040,0irq/26-eth0-rx-0-21swapper/323:27:383
29715040,0irq/26-eth0-rx-0-21swapper/323:02:513
29715040,0irq/26-eth0-rx-0-21swapper/322:18:363
29715040,0irq/26-eth0-rx-0-21swapper/321:44:523
29715040,0irq/26-eth0-rx-0-21swapper/321:07:553
29715040,0irq/26-eth0-rx-0-21swapper/320:53:383
29715040,0irq/26-eth0-rx-0-21swapper/320:47:383
29715040,0irq/26-eth0-rx-0-21swapper/320:07:383
29715040,0irq/26-eth0-rx-0-21swapper/319:32:363
29715040,0irq/26-eth0-rx-0-21swapper/318:52:373
29715040,0irq/26-eth0-rx-0-21swapper/300:06:483
259940,0migration/29548-21if_eth1.218:47:422
259940,0migration/27799-21kthreadcore19:07:412
259940,0migration/25593-21gltestperf19:57:382
259940,0migration/25593-21gltestperf19:57:382
259940,0migration/231912-21kthreadcore19:27:422
259940,0migration/217024-21kthreadcore22:12:442
259940,0migration/213908-21kthreadcore19:37:442
259940,0migration/211109-21latency20:22:432
249940,0watchdog/228796-21cpuspeed_turbos19:02:392
249940,0watchdog/223846-21python20:07:472
249940,0watchdog/215962-21cut20:02:432
249940,0watchdog/20-21swapper/223:52:422
249940,0watchdog/20-21swapper/223:37:422
249940,0watchdog/20-21swapper/222:02:382
249940,0watchdog/20-21swapper/219:22:432
179940,0migration/19024-21taskset19:08:261
179940,0migration/18937-21kthreadcore19:57:421
179940,0migration/18937-21kthreadcore19:57:421
179940,0migration/17930-21kthreadcore21:27:381
179940,0migration/132633-21kthreadcore21:22:401
179940,0migration/131489-21kthreadcore22:02:431
179940,0migration/131478-21kthreadcore22:22:411
179940,0migration/122772-21kthreadcore23:17:411
179940,0migration/122728-21fschecks_time21:37:381
179940,0migration/122654-21idleruntime-cro19:22:251
179940,0migration/122240-21kthreadcore19:42:431
179940,0migration/118932-21kthreadcore21:12:431
179940,0migration/117583-21kthreadcore20:52:421
179940,0migration/116836-21kthreadcore18:52:421
179940,0migration/113731-21taskset21:10:071
179940,0migration/112725-21irqrtprio20:02:411
179940,0migration/111406-21kthreadcore19:12:431
179940,0migration/110020-21taskset19:34:071
169940,0watchdog/17257-21kthreadcore23:47:421
169940,0watchdog/16559-21runrttasks20:48:591
169940,0watchdog/126975-40yum-updatesd-he20:37:431
169940,0watchdog/124658-21kthreadcore22:37:421
169940,0watchdog/10-21swapper/123:22:421
169940,0watchdog/10-21swapper/121:17:421
169940,0watchdog/10-21swapper/119:27:391
149940,0migration/032597-21kthreadcore21:22:400
149940,0migration/022149-21kthreadcore23:17:410
149940,0migration/012377-21munin-node21:27:450
83799932,0cyclictest32392-21awk20:17:392
83799932,0cyclictest25883-21basename20:37:362
83799932,0cyclictest17217-21awk19:17:412
83799930,0cyclictest0-21swapper/219:47:362
83789933,0cyclictest25701-21awk20:12:391
83789933,0cyclictest0-21swapper/120:19:501
83789932,0cyclictest3514-21snmpd20:27:261
83789932,0cyclictest2485-21kthreadcore20:42:411
83789932,0cyclictest22757-21awk18:57:391
83789930,0cyclictest5897-21awk21:47:391
83779933,0cyclictest9535-21kworker/0:023:32:290
83779933,0cyclictest9535-21kworker/0:022:37:390
83779933,0cyclictest9535-21kworker/0:022:27:350
83779933,0cyclictest9535-21kworker/0:022:07:290
83779933,0cyclictest9535-21kworker/0:021:37:320
83779933,0cyclictest9535-21kworker/0:019:32:340
83779933,0cyclictest9535-21kworker/0:019:27:400
83779933,0cyclictest9535-21kworker/0:019:12:320
83779933,0cyclictest16766-21kworker/0:223:42:250
83779933,0cyclictest16766-21kworker/0:200:07:250
83779932,0cyclictest28004-21basename23:02:340
83779932,0cyclictest22787-21munin-node20:57:480
339930,0migration/326244-21kthreadcore18:57:423
29715030,0irq/26-eth0-rx-0-21swapper/320:44:053
29715030,0irq/26-eth0-rx-0-21swapper/320:22:533
29715030,0irq/26-eth0-rx-0-21swapper/320:13:463
29715030,0irq/26-eth0-rx-0-21swapper/319:47:363
29715030,0irq/26-eth0-rx-0-21swapper/318:52:103
249930,0watchdog/20-21swapper/218:57:392
179930,0migration/116018-21ntp_states19:37:471
169930,0watchdog/19133-21kthreadcore20:22:431
169930,0watchdog/10-21swapper/119:02:391
169930,0watchdog/10-21swapper/100:12:261
29715020,0irq/26-eth0-rx-0-21swapper/320:17:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional