You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 07:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Aug 18, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2410327675,0sleep00-21swapper/018:44:190
2413727271,0sleep30-21swapper/318:44:423
2394926261,0sleep20-21swapper/218:42:292
2412023329,0sleep10-21swapper/118:44:281
339960,0migration/34899-21sh21:34:183
339960,0migration/325460-21sh00:11:143
339960,0migration/315364-21idleruntime21:21:483
339960,0migration/312801-21sh21:39:103
339960,0migration/311575-21sh21:57:133
339960,0migration/311380-21munin-node23:41:493
29715060,0irq/26-eth0-rx-30621-21yum18:46:593
29715060,0irq/26-eth0-rx-30621-21yum18:46:593
29715060,0irq/26-eth0-rx-28700-21unixbench-2d21:06:553
29715060,0irq/26-eth0-rx-0-21swapper/323:19:383
243719966,0cyclictest0-21swapper/219:06:542
243699965,0cyclictest0-21swapper/023:36:570
243699960,0cyclictest0-21swapper/021:23:160
149960,0migration/024854-21sh23:47:310
149960,0migration/021050-21cpuspeed_turbos19:56:470
35150,0ktimersoftd/30-21swapper/319:16:403
339950,0migration/37749-21munin-node23:56:553
339950,0migration/36456-21aten_r1power_fr20:56:453
339950,0migration/36350-21idleruntime18:56:473
339950,0migration/35045-21sh21:12:533
339950,0migration/329933-21kthreadcore23:11:503
339950,0migration/329869-21gltestperf22:11:463
339950,0migration/328318-21aten_r1power_cu20:26:473
339950,0migration/328009-21kthreadcore23:51:483
339950,0migration/327589-21kthreadcore20:46:483
339950,0migration/327539-21kthreadcore21:26:503
339950,0migration/327529-21taskset22:29:103
339950,0migration/327220-21gltestperf19:36:483
339950,0migration/321481-21gltestperf19:56:483
339950,0migration/320061-21munin-node19:51:573
339950,0migration/319671-21gltestperf23:26:463
339950,0migration/317682-21kthreadcore21:01:523
339950,0migration/315603-21taskset20:40:273
339950,0migration/313660-21kthreadcore23:21:493
29725050,0irq/27-eth0-tx-9429-21kthreadcore22:16:512
29725050,0irq/27-eth0-tx-0-21swapper/200:06:462
29725050,0irq/27-eth0-tx-0-21swapper/020:36:450
29715050,0irq/26-eth0-rx-8736-21kthreadcore22:16:513
29715050,0irq/26-eth0-rx-5506-21kthreadcore22:36:503
29715050,0irq/26-eth0-rx-4003-21sendmail_mailst20:51:553
29715050,0irq/26-eth0-rx-3284-21ssh22:34:483
29715050,0irq/26-eth0-rx-32253-21iostat18:51:493
29715050,0irq/26-eth0-rx-28710-21kthreadcore00:11:503
29715050,0irq/26-eth0-rx-21602-21df_abs22:06:463
29715050,0irq/26-eth0-rx-1939-21ssh23:35:503
29715050,0irq/26-eth0-rx-18802-21df_abs23:46:443
29715050,0irq/26-eth0-rx-11414-21kthreadcore19:46:523
29715050,0irq/26-eth0-rx-0-21swapper/323:38:053
29715050,0irq/26-eth0-rx-0-21swapper/323:02:033
29715050,0irq/26-eth0-rx-0-21swapper/322:51:433
29715050,0irq/26-eth0-rx-0-21swapper/322:24:353
29715050,0irq/26-eth0-rx-0-21swapper/322:01:543
29715050,0irq/26-eth0-rx-0-21swapper/321:41:503
29715050,0irq/26-eth0-rx-0-21swapper/321:16:533
29715050,0irq/26-eth0-rx-0-21swapper/319:06:503
27150,0ktimersoftd/20-21swapper/220:48:162
259950,0migration/24994-21sh21:12:462
259950,0migration/23973-21munin-node22:56:452
259950,0migration/228158-21latency_hist20:26:332
259950,0migration/221324-21needreboot20:41:532
259950,0migration/213779-21sh21:20:042
259950,0migration/210406-21kthreadcore19:21:502
243719950,0cyclictest27789-21ssh22:29:582
243709950,0cyclictest22368-21diskmemload22:00:571
243709950,0cyclictest0-21swapper/100:06:451
243699955,0cyclictest13540-21kworker/0:022:37:200
243699955,0cyclictest0-21swapper/023:57:180
243699955,0cyclictest0-21swapper/023:00:510
243699955,0cyclictest0-21swapper/021:04:590
243699955,0cyclictest0-21swapper/020:21:560
243699950,0cyclictest0-21swapper/022:34:220
243699950,0cyclictest0-21swapper/021:45:300
243699950,0cyclictest0-21swapper/020:48:060
243699950,0cyclictest0-21swapper/018:52:230
19150,0ktimersoftd/10-21swapper/119:16:401
179950,0migration/18378-21kthreadcore20:56:501
179950,0migration/13834-21ksmtuned22:36:221
179950,0migration/128885-21fschecks_time20:26:491
179950,0migration/127872-21if_eth1.223:31:491
179950,0migration/126551-21latency22:06:511
179950,0migration/126104-21taskset23:51:211
179950,0migration/125693-21kthreadcore20:46:481
179950,0migration/121856-21unixbench_multi20:41:581
179950,0migration/121657-21sh21:25:011
179950,0migration/118689-21munin-node22:21:561
179950,0migration/118072-21timerwakeupswit19:01:581
179950,0migration/110861-21mdstat18:56:511
149950,0migration/09895-21kthreadcore18:56:500
149950,0migration/07322-21kthreadcore21:56:510
149950,0migration/07227-21idleruntime20:56:480
149950,0migration/06072-21taskset21:16:000
149950,0migration/05248-21munin-node19:16:530
149950,0migration/05112-21kthreadcore19:41:500
149950,0migration/031645-21kthreadcore21:51:490
149950,0migration/030401-21kthreadcore19:36:520
149950,0migration/029594-21kthreadcore20:01:520
149950,0migration/028763-21sh21:27:310
149950,0migration/027636-21irqrtprio23:51:480
149950,0migration/021555-21munin-node22:06:460
149950,0migration/019406-21taskset19:29:430
149950,0migration/019243-21cpuspeed_turbos23:26:450
149950,0migration/018697-21idleruntime-cro23:26:320
149950,0migration/016049-21aten_r1power_po20:41:450
149950,0migration/014470-21munin-node19:51:470
149950,0migration/013885-21sh21:20:230
149950,0migration/012146-21kthreadcore23:41:520
149950,0migration/010186-21kthreadcore19:46:520
339940,0migration/3576-21latency_hist19:41:333
339940,0migration/320389-21fschecks_time19:31:473
339940,0migration/319369-21kthreadcore20:16:513
339940,0migration/316198-21kthreadcore19:26:503
339940,0migration/314847-21kthreadcore19:01:523
339940,0migration/313143-21kthreadcore00:01:523
339940,0migration/311400-21kthreadcore20:11:503
29725040,0irq/27-eth0-tx-9664-21ssh23:18:162
29725040,0irq/27-eth0-tx-5875-21ssh21:36:342
29725040,0irq/27-eth0-tx-4173-21munin-node22:36:482
29725040,0irq/27-eth0-tx-29711-21munin-node21:51:502
29725040,0irq/27-eth0-tx-29154-21munin-node22:11:552
29725040,0irq/27-eth0-tx-29113-21irqcore22:51:472
29725040,0irq/27-eth0-tx-25648-21aten2.4-expect19:11:440
29725040,0irq/27-eth0-tx-20172-21telnet22:46:452
29725040,0irq/27-eth0-tx-18238-21ssh22:41:552
29725040,0irq/27-eth0-tx-14603-21aten2.4-expect21:21:452
29725040,0irq/27-eth0-tx-0-21swapper/223:56:482
29725040,0irq/27-eth0-tx-0-21swapper/223:11:422
29725040,0irq/27-eth0-tx-0-21swapper/222:34:212
29725040,0irq/27-eth0-tx-0-21swapper/222:22:302
29725040,0irq/27-eth0-tx-0-21swapper/221:41:492
29725040,0irq/27-eth0-tx-0-21swapper/221:06:442
29725040,0irq/27-eth0-tx-0-21swapper/221:01:352
29725040,0irq/27-eth0-tx-0-21swapper/220:56:372
29725040,0irq/27-eth0-tx-0-21swapper/200:12:052
29715040,0irq/26-eth0-rx-0-21swapper/323:07:483
29715040,0irq/26-eth0-rx-0-21swapper/322:56:543
29715040,0irq/26-eth0-rx-0-21swapper/322:46:503
29715040,0irq/26-eth0-rx-0-21swapper/322:44:183
29715040,0irq/26-eth0-rx-0-21swapper/321:51:483
29715040,0irq/26-eth0-rx-0-21swapper/321:46:543
29715040,0irq/26-eth0-rx-0-21swapper/320:06:543
259940,0migration/27898-21runrttasks23:36:492
259940,0migration/27781-21df_abs19:46:472
259940,0migration/227696-21kthreadcore21:26:502
259940,0migration/226192-21fschecks_time19:11:462
259940,0migration/222761-21kthreadcore22:06:502
259940,0migration/221548-21kthreadcore23:26:502
259940,0migration/216621-21kthreadcore20:16:502
243719943,0cyclictest6480-21awk18:56:482
243719943,0cyclictest3556-21lldpd20:01:542
243719943,0cyclictest3556-21lldpd18:49:532
243719943,0cyclictest3556-21lldpd18:49:532
243719943,0cyclictest3514-21snmpd20:38:052
243719943,0cyclictest3514-21snmpd19:16:352
243719943,0cyclictest3441-21awk20:31:492
243719943,0cyclictest3241-21irqbalance22:01:512
243719943,0cyclictest31422-21awk20:51:482
243719943,0cyclictest31325-21awk21:31:502
243719943,0cyclictest27849-21awk23:31:482
243719943,0cyclictest27328-21awk23:51:462
243719943,0cyclictest22700-21awk21:46:472
243719943,0cyclictest19440-21awk23:46:472
243719943,0cyclictest1597-21awk19:41:482
243719943,0cyclictest14942-21awk19:51:492
243719943,0cyclictest11980-21awk23:21:472
243719943,0cyclictest11424-21awk23:41:502
243719942,0cyclictest20377-21awk23:06:472
243719940,0cyclictest0-21swapper/223:01:392
243719940,0cyclictest0-21swapper/200:01:472
243709944,0cyclictest0-21swapper/123:28:081
243709943,0cyclictest3556-21lldpd23:41:551
243709943,0cyclictest3556-21lldpd19:41:241
243709943,0cyclictest3241-21irqbalance22:51:411
243709943,0cyclictest3241-21irqbalance21:27:111
243709943,0cyclictest3241-21irqbalance21:16:411
243709943,0cyclictest3241-21irqbalance21:12:311
243709943,0cyclictest3241-21irqbalance18:51:521
243709943,0cyclictest28356-21awk23:11:481
243709943,0cyclictest26490-21awk19:11:481
243709943,0cyclictest21707-21awk19:56:501
243709943,0cyclictest14912-21awk19:51:481
243709943,0cyclictest1346-21sadc20:06:331
243709940,0cyclictest0-21swapper/122:37:131
243699944,0cyclictest19652-21kworker/0:022:03:420
243699944,0cyclictest19652-21kworker/0:021:41:220
243699944,0cyclictest19652-21kworker/0:021:07:140
243699944,0cyclictest19652-21kworker/0:020:06:510
243699944,0cyclictest19652-21kworker/0:019:31:490
243699944,0cyclictest0-21swapper/022:54:520
243699944,0cyclictest0-21swapper/022:25:320
243699944,0cyclictest0-21swapper/022:19:330
243699943,0cyclictest3556-21lldpd23:13:240
243699943,0cyclictest21013-21awk22:46:490
243699943,0cyclictest20425-21awk23:06:470
243699943,0cyclictest18643-21sadc19:06:340
243699943,0cyclictest15917-21awk20:16:490
243699943,0cyclictest13148-21awk22:41:470
243699943,0cyclictest12625-21awk23:01:490
249940,0watchdog/228301-21munin-node20:26:512
249940,0watchdog/226881-21forks19:36:472
249940,0watchdog/223478-21kthreadcore19:56:512
249940,0watchdog/20-21swapper/221:56:512
249940,0watchdog/20-21swapper/220:06:512
249940,0watchdog/20-21swapper/219:31:472
249940,0watchdog/20-21swapper/219:26:562
249940,0watchdog/20-21swapper/219:01:522
19140,0ktimersoftd/10-21swapper/100:15:171
179940,0migration/15625-21kthreadcore23:16:491
179940,0migration/14510-21taskset20:52:181
179940,0migration/132712-21taskset23:52:271
179940,0migration/129736-21fschecks_time22:11:461
179940,0migration/126550-21kthreadcore20:21:511
179940,0migration/123895-21kthreadcore21:46:491
179940,0migration/123480-21gltestperf21:06:451
179940,0migration/122477-21kthreadcore23:06:501
179940,0migration/120277-21fschecks_count19:31:471
179940,0migration/120216-21aten_r1power_po22:46:451
179940,0migration/116897-21timerandwakeup23:21:541
179940,0migration/115672-21kthreadcore23:01:511
179940,0migration/115327-21runrttasks20:37:261
179940,0migration/113273-21irqcore22:41:471
179940,0migration/112064-21kthreadcore00:01:521
169940,0watchdog/19738-21grep19:46:511
169940,0watchdog/18046-21tr22:16:511
169940,0watchdog/16536-21fschecks_time21:36:471
169940,0watchdog/14070-21kthreadcore20:31:511
169940,0watchdog/131434-21irqcore21:31:511
169940,0watchdog/128524-21cut18:46:521
169940,0watchdog/128524-21cut18:46:521
169940,0watchdog/12545-21aten2.4-expect23:36:431
169940,0watchdog/12235-21tune2fs20:06:471
169940,0watchdog/121398-21fschecks_time22:26:471
169940,0watchdog/119004-21timerwakeupswit19:26:561
169940,0watchdog/116576-21kthreadcore21:01:511
169940,0watchdog/115481-21grep22:01:511
169940,0watchdog/113629-21memory20:11:511
149940,0migration/07195-21kthreadcore23:16:490
149940,0migration/0563-21kthreadcore20:26:530
149940,0migration/04446-21sh21:32:540
149940,0migration/032037-21sh00:12:120
149940,0migration/027609-21taskset23:31:470
149940,0migration/025994-21latency22:26:510
149940,0migration/023754-21kthreadcore19:06:500
339930,0migration/38940-21runrttasks20:35:363
339930,0migration/37645-21irqcore19:21:483
29715030,0irq/26-eth0-rx-0-21swapper/320:01:463
29715030,0irq/26-eth0-rx-0-21swapper/319:11:573
243719932,0cyclictest32161-21awk18:51:482
243709932,0cyclictest7210-21sadc19:46:331
243709932,0cyclictest3556-21lldpd21:41:541
243709932,0cyclictest3241-21irqbalance22:56:411
243709932,0cyclictest2834-21awk23:56:491
243709932,0cyclictest19785-21awk19:06:481
243709931,0cyclictest6467-21runrttasks19:21:341
243699933,0cyclictest27012-21kworker/0:222:11:500
243699933,0cyclictest19652-21kworker/0:021:46:460
243699933,0cyclictest19652-21kworker/0:020:51:500
243699933,0cyclictest13540-21kworker/0:000:06:360
243699932,0cyclictest3306-21gltestperf20:31:480
243699932,0cyclictest30298-21grep18:46:570
243699932,0cyclictest30298-21grep18:46:570
243699932,0cyclictest10923-21awk00:01:500
243699930,0cyclictest7133-21perl19:21:460
249930,0watchdog/20-21swapper/220:11:512
169930,0watchdog/118072-21kthreadcore20:16:511
169930,0watchdog/10-21swapper/121:51:551
29715020,0irq/26-eth0-rx-0-21swapper/320:42:183
29715020,0irq/26-eth0-rx-0-21swapper/320:21:553
243699920,0cyclictest0-21swapper/020:11:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional