You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 02:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Apr 26, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
427328988,0sleep20-21swapper/218:54:332
432324029,0sleep00-21swapper/018:55:070
304450350,0irq/25-eth10-21swapper/318:53:393
421123122,0sleep10-21swapper/118:53:481
45899976,0cyclictest0-21swapper/021:06:520
35160,0ktimersoftd/30-21swapper/321:37:423
35160,0ktimersoftd/30-21swapper/321:37:423
339960,0migration/39927-21sh22:21:423
339960,0migration/37462-21sh23:58:053
339960,0migration/332348-21sh23:54:533
339960,0migration/325206-21runrttasks21:27:463
339960,0migration/324867-21sh23:10:013
339960,0migration/324491-21latency21:07:423
339960,0migration/317518-21sh22:25:253
339960,0migration/317017-21sh23:05:223
339960,0migration/314347-21munin-node19:52:413
29725060,0irq/27-eth0-tx-0-21swapper/020:14:420
29715060,0irq/26-eth0-rx-730-21python21:32:473
29715060,0irq/26-eth0-rx-2865-21munin-node20:57:363
29715060,0irq/26-eth0-rx-10087-21df_inode23:22:363
8215050,0irq/24-0000:00:19397-21df19:32:372
8215050,0irq/24-0000:00:1088-21munin-run23:37:232
45919955,0cyclictest0-21swapper/223:52:362
45919955,0cyclictest0-21swapper/222:14:142
45919955,0cyclictest0-21swapper/221:44:542
45919955,0cyclictest0-21swapper/221:18:162
45919955,0cyclictest0-21swapper/221:07:422
45919955,0cyclictest0-21swapper/200:07:262
45919950,0cyclictest0-21swapper/222:54:542
45919950,0cyclictest0-21swapper/220:02:352
45909950,0cyclictest0-21swapper/121:57:351
45909950,0cyclictest0-21swapper/121:43:231
45909950,0cyclictest0-21swapper/100:24:121
45899955,0cyclictest645-21kworker/0:022:37:550
45899955,0cyclictest2331-21kworker/0:220:27:360
45899955,0cyclictest0-21swapper/021:33:300
45899955,0cyclictest0-21swapper/000:11:480
45899954,0cyclictest26748-21tr19:37:410
45899954,0cyclictest10984-21kworker/0:123:38:590
45899950,0cyclictest0-21swapper/022:42:240
45899950,0cyclictest0-21swapper/021:19:470
45899950,0cyclictest0-21swapper/000:20:000
35150,0ktimersoftd/30-21swapper/320:34:383
35150,0ktimersoftd/30-21swapper/300:05:203
339950,0migration/36783-21kthreadcore22:37:413
339950,0migration/36185-21kthreadcore00:17:423
339950,0migration/329014-21kthreadcore22:52:423
339950,0migration/326743-21munin-node23:32:403
339950,0migration/326123-21munin-node19:37:383
339950,0migration/322833-21munin-node00:07:453
339950,0migration/321848-21kthreadcore19:57:413
339950,0migration/318557-21aten2.4-expect22:27:353
339950,0migration/318186-21fschecks_count23:27:373
339950,0migration/315326-21kthreadcore22:02:413
339950,0migration/31420-21munin-node20:52:433
339950,0migration/313834-21latency20:37:423
339950,0migration/313415-21kthreadcore21:22:413
339950,0migration/313415-21kthreadcore21:22:413
339950,0migration/313034-21kthreadcore19:02:433
339950,0migration/311512-21kthreadcore00:22:413
339950,0migration/311343-21cpuspeed_turbos21:42:353
339950,0migration/310973-21taskset18:58:553
339950,0migration/310466-21kthreadcore19:22:433
29725050,0irq/27-eth0-tx-8857-21ssh22:59:552
29725050,0irq/27-eth0-tx-5453-21kthreadcore23:17:422
29725050,0irq/27-eth0-tx-4642-21kthreadcore23:37:412
29725050,0irq/27-eth0-tx-25205-21ssh23:31:372
29725050,0irq/27-eth0-tx-21121-21kthreadcore23:07:412
29725050,0irq/27-eth0-tx-14740-21python00:22:462
29725050,0irq/27-eth0-tx-1075-21ssh23:16:502
29725050,0irq/27-eth0-tx-0-21swapper/222:08:262
29725050,0irq/27-eth0-tx-0-21swapper/020:52:100
29715050,0irq/26-eth0-rx-8180-21fschecks_count20:12:373
29715050,0irq/26-eth0-rx-6559-21runrttasks00:13:163
29715050,0irq/26-eth0-rx-5341-21tr23:17:423
29715050,0irq/26-eth0-rx-24678-21ntpq21:47:463
29715050,0irq/26-eth0-rx-0-21swapper/323:47:083
29715050,0irq/26-eth0-rx-0-21swapper/323:37:373
29715050,0irq/26-eth0-rx-0-21swapper/322:59:143
29715050,0irq/26-eth0-rx-0-21swapper/322:48:433
29715050,0irq/26-eth0-rx-0-21swapper/322:45:553
29715050,0irq/26-eth0-rx-0-21swapper/322:16:383
29715050,0irq/26-eth0-rx-0-21swapper/321:52:373
29715050,0irq/26-eth0-rx-0-21swapper/321:17:423
29715050,0irq/26-eth0-rx-0-21swapper/321:12:343
29715050,0irq/26-eth0-rx-0-21swapper/320:07:423
27150,0ktimersoftd/20-21swapper/222:26:312
27150,0ktimersoftd/20-21swapper/222:06:592
259950,0migration/28643-21aten_r1power_fr20:37:362
259950,0migration/230007-21kthreadcore21:52:422
259950,0migration/220730-21pmu-power20:42:442
259950,0migration/214984-21fschecks_time20:17:382
249950,0watchdog/224588-21kthreadcore20:47:432
249950,0watchdog/221213-21kthreadcore21:47:422
249950,0watchdog/214996-21sensors00:02:462
249950,0watchdog/210544-21kthreadcore19:22:432
179950,0migration/1975-21sh22:55:421
179950,0migration/19244-21aten_r1power_cu00:02:341
179950,0migration/18097-21taskset23:39:071
179950,0migration/14734-21kthreadcore22:57:401
179950,0migration/132601-21munin-node22:32:481
179950,0migration/121932-21kthreadcore22:07:421
179950,0migration/120081-21kthreadcore23:47:411
179950,0migration/11757-21latency_hist20:32:251
179950,0migration/112224-21munin-node19:47:471
169950,0watchdog/10-21swapper/121:32:421
169950,0watchdog/10-21swapper/100:17:421
149950,0migration/09785-21kthreadcore19:22:430
149950,0migration/09407-21turbostat23:22:230
149950,0migration/08452-21sh00:00:570
149950,0migration/04792-21taskset18:57:280
149950,0migration/04365-21kernelversion21:37:420
149950,0migration/04365-21kernelversion21:37:420
149950,0migration/031405-21sh23:32:450
149950,0migration/028170-21kthreadcore23:12:400
149950,0migration/027130-21latency_hist21:12:250
149950,0migration/024658-21timerandwakeup22:07:480
149950,0migration/023500-21kthreadcore21:47:430
149950,0migration/020076-21munin-node19:32:410
149950,0migration/019487-21taskset19:53:440
149950,0migration/018367-21latency_hist22:27:230
149950,0migration/015943-21missed_timers22:22:430
149950,0migration/015655-21munin-node20:42:370
149950,0migration/015261-21sendmail_mailst23:42:440
149950,0migration/015016-21kthreadcore22:02:410
149950,0migration/014429-21munin-node20:17:360
149950,0migration/013559-21kthreadcore20:37:420
149950,0migration/012536-21irqcore19:02:420
149950,0migration/012118-21kthreadcore23:22:400
149950,0migration/011568-21kthreadcore00:02:400
149950,0migration/010139-21aten_r1power_vo23:02:360
45919943,0cyclictest3556-21lldpd22:27:242
45919943,0cyclictest3556-21lldpd22:18:242
45919943,0cyclictest3556-21lldpd20:25:222
45919943,0cyclictest3556-21lldpd19:47:532
45919943,0cyclictest3556-21lldpd19:10:532
45919943,0cyclictest27872-21grep20:27:362
45909943,0cyclictest3556-21lldpd22:51:241
45909943,0cyclictest3556-21lldpd21:13:521
45909943,0cyclictest3556-21lldpd21:04:221
45909943,0cyclictest3556-21lldpd20:50:521
45909943,0cyclictest3556-21lldpd00:07:241
45909943,0cyclictest3514-21snmpd20:11:451
45909943,0cyclictest3241-21irqbalance23:17:421
45909943,0cyclictest3241-21irqbalance22:40:421
45909943,0cyclictest16125-21awk20:42:391
45909940,0cyclictest0-21swapper/119:52:521
45899944,0cyclictest645-21kworker/0:022:32:490
45899944,0cyclictest645-21kworker/0:022:17:370
45899944,0cyclictest645-21kworker/0:022:13:210
45899944,0cyclictest645-21kworker/0:021:52:330
45899944,0cyclictest645-21kworker/0:021:27:360
45899944,0cyclictest645-21kworker/0:021:22:520
45899944,0cyclictest645-21kworker/0:021:22:520
45899944,0cyclictest2331-21kworker/0:221:12:300
45899944,0cyclictest2331-21kworker/0:220:52:320
45899944,0cyclictest2331-21kworker/0:220:32:380
45899944,0cyclictest2331-21kworker/0:220:02:440
45899944,0cyclictest2331-21kworker/0:219:47:500
45899944,0cyclictest2331-21kworker/0:219:42:360
45899944,0cyclictest10984-21kworker/0:123:48:330
45899944,0cyclictest10984-21kworker/0:123:28:010
45899944,0cyclictest10984-21kworker/0:123:07:410
45899944,0cyclictest10984-21kworker/0:122:52:330
45899944,0cyclictest10984-21kworker/0:122:47:390
45899944,0cyclictest10984-21kworker/0:100:22:390
45899944,0cyclictest10984-21kworker/0:100:12:470
45899943,0cyclictest3514-21snmpd19:13:300
45899943,0cyclictest26363-21awk23:52:390
45899943,0cyclictest19052-21awk19:07:390
45899941,0cyclictest0-21swapper/019:17:360
339940,0migration/3937-21kthreadcore19:17:423
339940,0migration/330507-21switchtime19:12:483
339940,0migration/32338-21kthreadcore19:42:403
339940,0migration/318495-21kthreadcore20:42:413
29725040,0irq/27-eth0-tx-789-21munin-node00:17:432
29725040,0irq/27-eth0-tx-32762-21ssh22:33:112
29725040,0irq/27-eth0-tx-0-21swapper/223:57:352
29725040,0irq/27-eth0-tx-0-21swapper/222:49:132
29725040,0irq/27-eth0-tx-0-21swapper/222:42:292
29725040,0irq/27-eth0-tx-0-21swapper/222:37:462
29725040,0irq/27-eth0-tx-0-21swapper/221:57:362
29725040,0irq/27-eth0-tx-0-21swapper/221:27:412
29725040,0irq/27-eth0-tx-0-21swapper/221:22:272
29725040,0irq/27-eth0-tx-0-21swapper/221:22:272
29725040,0irq/27-eth0-tx-0-21swapper/220:58:022
29725040,0irq/27-eth0-tx-0-21swapper/020:57:390
29725040,0irq/27-eth0-tx-0-21swapper/020:22:420
29715040,0irq/26-eth0-rx-32338-21smartctl20:02:463
29715040,0irq/26-eth0-rx-0-21swapper/323:47:413
29715040,0irq/26-eth0-rx-0-21swapper/323:12:353
29715040,0irq/26-eth0-rx-0-21swapper/322:33:133
29715040,0irq/26-eth0-rx-0-21swapper/322:08:533
29715040,0irq/26-eth0-rx-0-21swapper/321:57:413
29715040,0irq/26-eth0-rx-0-21swapper/321:02:423
29715040,0irq/26-eth0-rx-0-21swapper/319:32:363
29715040,0irq/26-eth0-rx-0-21swapper/319:27:363
259940,0migration/25095-21cpuspeed_turbos18:57:362
259940,0migration/24982-21kthreadcore21:37:422
259940,0migration/24982-21kthreadcore21:37:422
259940,0migration/226853-21irqcore19:37:412
259940,0migration/222912-21kthreadcore19:57:412
259940,0migration/219966-21kthreadcore23:47:412
259940,0migration/216082-21runrttasks23:23:312
259940,0migration/214686-21munin-node19:52:422
259940,0migration/213543-21unixbench-2d20:12:472
259940,0migration/213181-21runrttasks19:27:382
259940,0migration/213120-21kthreadcore23:02:412
259940,0migration/21266-21kthreadcore20:52:422
259940,0migration/211297-21kthreadcore23:42:402
249940,0watchdog/23225-21kthreadcore19:17:432
249940,0watchdog/225381-21sh00:12:342
249940,0watchdog/213181-21tr19:02:432
249940,0watchdog/20-21swapper/221:32:422
249940,0watchdog/20-21swapper/221:12:422
249940,0watchdog/20-21swapper/221:02:422
179940,0migration/19299-21kthreadcore18:57:421
179940,0migration/14857-21kthreadcore22:17:421
179940,0migration/14235-21kthreadcore23:57:421
179940,0migration/1415-21munin-node21:52:481
179940,0migration/13694-21kthreadcore19:42:411
179940,0migration/132535-21kthreadcore20:52:421
179940,0migration/131849-21kthreadcore20:27:411
179940,0migration/127703-21if_eth122:12:391
179940,0migration/127216-21kthreadcore23:32:411
179940,0migration/125783-21kthreadcore20:22:411
179940,0migration/122649-21kthreadcore23:27:411
179940,0migration/122368-21kthreadcore21:07:421
179940,0migration/120116-21gltestperf21:27:371
179940,0migration/118872-21gltestperf19:07:381
179940,0migration/117264-21taskset23:06:051
179940,0migration/115157-21munin-node23:22:411
179940,0migration/112645-21kthreadcore22:02:401
179940,0migration/110169-21kthreadcore20:37:411
169940,0watchdog/1645-21ssh23:15:421
169940,0watchdog/14676-21kthreadcore21:17:421
169940,0watchdog/130764-21sh00:12:421
169940,0watchdog/129297-21kthreadcore23:52:421
169940,0watchdog/124783-21ssh23:09:461
169940,0watchdog/124067-21cut19:32:431
169940,0watchdog/122977-21kthreadcore22:27:421
169940,0watchdog/121212-21kthreadcore21:47:421
169940,0watchdog/116730-21ssh23:45:581
169940,0watchdog/115663-21ssh22:22:421
169940,0watchdog/110985-21hwlatdetect22:42:381
169940,0watchdog/10-21swapper/120:57:421
169940,0watchdog/10-21swapper/119:12:431
169940,0watchdog/10-21swapper/119:02:471
149940,0migration/03480-21kthreadcore22:57:400
149940,0migration/02824-21aten2.4-expect21:57:360
149940,0migration/020329-21cpuspeed_turbos19:57:370
149940,0migration/014630-21kthreadcore21:42:400
45919932,0cyclictest25666-21awk19:12:402
45919932,0cyclictest1490-21grep20:07:382
45919930,0cyclictest32379-21date19:42:252
45909932,0cyclictest6548-21hwlatdetect19:22:391
45909932,0cyclictest3880-21sort21:37:401
45909932,0cyclictest3880-21sort21:37:401
45909932,0cyclictest3556-21lldpd20:04:221
45909932,0cyclictest31401-21sensors19:37:461
45909932,0cyclictest20837-21cat20:22:251
45909932,0cyclictest13322-21sensors20:12:451
45909930,0cyclictest0-21swapper/119:31:261
45899933,0cyclictest2331-21kworker/0:220:07:260
45899933,0cyclictest2331-21kworker/0:219:27:260
29715030,0irq/26-eth0-rx-0-21swapper/320:47:433
29715030,0irq/26-eth0-rx-0-21swapper/320:30:583
29715030,0irq/26-eth0-rx-0-21swapper/320:22:363
29715030,0irq/26-eth0-rx-0-21swapper/319:50:563
249930,0watchdog/20-21swapper/220:32:432
169930,0watchdog/10-21swapper/121:22:421
169930,0watchdog/10-21swapper/121:22:421
169930,0watchdog/10-21swapper/119:57:431
169930,0watchdog/10-21swapper/119:17:391
29715020,0irq/26-eth0-rx-0-21swapper/320:17:403
29715020,0irq/26-eth0-rx-0-21swapper/319:07:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional