You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 00:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 28, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2859723524,0sleep30-21swapper/306:42:303
2878423122,0sleep10-21swapper/106:44:401
2871523022,0sleep20-21swapper/206:43:532
2854822925,0sleep00-21swapper/006:41:550
339960,0migration/37044-21sh10:52:343
339960,0migration/330165-21irqcore06:45:483
339960,0migration/316223-21sh10:18:173
29725060,0irq/27-eth0-tx-8782-21munin-node10:35:522
29715060,0irq/26-eth0-rx-4907-21proc_pri11:30:533
29715060,0irq/26-eth0-rx-18789-21cut07:25:493
29715060,0irq/26-eth0-rx-18495-21ssh08:59:523
29715060,0irq/26-eth0-rx-0-21swapper/311:35:503
289339960,0cyclictest0-21swapper/211:10:592
289339960,0cyclictest0-21swapper/207:25:512
289329965,0cyclictest32105-21grep07:35:481
289329960,0cyclictest0-21swapper/109:40:461
289319960,0cyclictest13675-21ssh11:58:330
149960,0migration/09168-21switchtime06:50:560
149960,0migration/08926-21aten_r1power_vo10:35:430
149960,0migration/03675-21kthreadcore11:30:500
149960,0migration/031359-21sh11:09:030
149960,0migration/021843-21sh12:04:100
8215050,0irq/24-0000:00:313-21turbostat08:25:332
8215050,0irq/24-0000:00:309-21latency_hist08:25:332
8215050,0irq/24-0000:00:23035-21sh10:41:192
339950,0migration/39606-21taskset06:52:263
339950,0migration/38139-21df_abs11:15:433
339950,0migration/38139-21df_abs11:15:433
339950,0migration/36906-21cpuspeed_turbos11:55:443
339950,0migration/36232-21idleruntime07:40:473
339950,0migration/35061-21munin-node08:00:533
339950,0migration/33484-21fschecks_time08:50:463
339950,0migration/331151-21kthreadcore08:45:503
339950,0migration/327993-21kthreadcore07:05:503
339950,0migration/326939-21fschecks_time08:20:473
339950,0migration/325743-21aten_r1power_en10:05:423
339950,0migration/325740-21munin-node10:45:483
339950,0migration/324985-21diskmemload09:21:093
339950,0migration/324000-21sh10:44:143
339950,0migration/323459-21munin-node11:45:443
339950,0migration/320335-21taskset08:38:583
339950,0migration/316870-21timerandwakeup07:20:563
339950,0migration/315793-21aten_r1power_po11:20:413
339950,0migration/314859-21munin-node12:00:443
339950,0migration/310720-21taskset07:18:453
339950,0migration/310678-21kthreadcore08:30:503
339950,0migration/310073-21latency_hist06:55:333
29725050,0irq/27-eth0-tx-6653-21munin-node11:55:482
29725050,0irq/27-eth0-tx-31367-21ssh11:09:042
29725050,0irq/27-eth0-tx-28255-21irqcore09:05:462
29725050,0irq/27-eth0-tx-27368-21munin-node08:45:540
29725050,0irq/27-eth0-tx-27120-21diskmemload09:28:462
29725050,0irq/27-eth0-tx-24836-21python09:00:542
29725050,0irq/27-eth0-tx-23630-21munin-node11:25:472
29725050,0irq/27-eth0-tx-22686-21basename12:05:432
29725050,0irq/27-eth0-tx-15141-21munin-node11:40:542
29725050,0irq/27-eth0-tx-10838-21ssh08:55:362
29725050,0irq/27-eth0-tx-10819-21munin-node09:15:462
29725050,0irq/27-eth0-tx-10181-21kthreadcore11:15:482
29725050,0irq/27-eth0-tx-10181-21kthreadcore11:15:482
29725050,0irq/27-eth0-tx-0-21swapper/212:01:492
29725050,0irq/27-eth0-tx-0-21swapper/211:37:522
29725050,0irq/27-eth0-tx-0-21swapper/211:01:102
29725050,0irq/27-eth0-tx-0-21swapper/210:16:152
29725050,0irq/27-eth0-tx-0-21swapper/007:22:470
29725050,0irq/27-eth0-tx-0-21swapper/007:10:560
29725050,0irq/27-eth0-tx-0-21swapper/006:47:370
29715050,0irq/26-eth0-rx-29689-21kthreadcore09:05:473
29715050,0irq/26-eth0-rx-27070-21kthreadcore07:30:493
29715050,0irq/26-eth0-rx-25700-21fschecks_time10:25:463
29715050,0irq/26-eth0-rx-25600-21unixbench-2d08:15:563
29715050,0irq/26-eth0-rx-2449-21cpu09:30:443
29715050,0irq/26-eth0-rx-23324-21munin-node10:00:533
29715050,0irq/26-eth0-rx-19730-21kthreadcore11:00:483
29715050,0irq/26-eth0-rx-18774-21grep10:20:493
29715050,0irq/26-eth0-rx-16075-21ssh10:39:203
29715050,0irq/26-eth0-rx-0-21swapper/311:08:493
29715050,0irq/26-eth0-rx-0-21swapper/310:12:363
29715050,0irq/26-eth0-rx-0-21swapper/309:58:503
29715050,0irq/26-eth0-rx-0-21swapper/309:46:023
29715050,0irq/26-eth0-rx-0-21swapper/309:35:503
29715050,0irq/26-eth0-rx-0-21swapper/309:29:143
29715050,0irq/26-eth0-rx-0-21swapper/309:20:063
29715050,0irq/26-eth0-rx-0-21swapper/309:13:323
29715050,0irq/26-eth0-rx-0-21swapper/309:01:513
29715050,0irq/26-eth0-rx-0-21swapper/307:10:503
289339955,0cyclictest0-21swapper/210:50:392
289339955,0cyclictest0-21swapper/209:45:232
289339950,0cyclictest0-21swapper/208:50:592
289329953,0cyclictest3556-21lldpd11:25:481
289329950,0cyclictest0-21swapper/110:25:131
289319955,0cyclictest0-21swapper/011:25:460
289319955,0cyclictest0-21swapper/011:00:510
289319955,0cyclictest0-21swapper/010:03:090
289319955,0cyclictest0-21swapper/009:54:570
289319955,0cyclictest0-21swapper/009:20:060
289319953,0cyclictest3241-21irqbalance09:25:210
289319950,0cyclictest0-21swapper/010:13:050
289319950,0cyclictest0-21swapper/009:57:000
289319950,0cyclictest0-21swapper/007:28:100
27150,0ktimersoftd/20-21swapper/210:10:282
259950,0migration/26504-21latency_hist11:55:322
259950,0migration/24702-21kthreadcore09:30:492
259950,0migration/24035-21timerandwakeup12:10:542
259950,0migration/23709-21kthreadcore09:50:512
259950,0migration/231480-21latency_hist11:30:332
259950,0migration/225021-21sh09:21:142
259950,0migration/219341-21munin-node08:35:512
259950,0migration/218834-21sh10:00:502
259950,0migration/216003-21latency_hist11:00:332
249950,0watchdog/218499-21cut11:20:472
249950,0watchdog/216389-21memory07:20:522
19150,0ktimersoftd/10-21swapper/110:10:281
179950,0migration/14476-21smart_sda11:50:551
179950,0migration/132075-21switchtime08:20:561
179950,0migration/129351-21kthreadcore10:45:501
179950,0migration/12637-21kthreadcore10:50:501
179950,0migration/116027-21kthreadcore08:55:491
179950,0migration/114166-21latency10:35:491
179950,0migration/111324-21kthreadcore11:35:501
149950,0migration/0820-21fschecks_time10:50:470
149950,0migration/04749-21kthreadcore09:10:470
149950,0migration/04486-21runrttasks12:11:360
149950,0migration/032678-21taskset10:08:130
149950,0migration/032173-21munin-node11:10:440
149950,0migration/027869-21kthreadcore07:55:490
149950,0migration/027502-21kthreadcore07:05:500
149950,0migration/027220-21munin-node08:20:480
149950,0migration/027122-21kthreadcore10:25:500
149950,0migration/025799-21sh09:45:180
149950,0migration/02362-21kthreadcore08:25:510
149950,0migration/023230-21kthreadcore08:40:490
149950,0migration/019555-21kthreadcore11:40:490
149950,0migration/019167-21kthreadcore07:00:500
149950,0migration/017988-21irqrtprio10:40:490
149950,0migration/016645-40yum-updatesd09:36:360
149950,0migration/014991-21kthreadcore07:45:500
149950,0migration/014086-21sh11:16:280
149950,0migration/014086-21sh11:16:280
149950,0migration/012366-21kthreadcore08:55:480
339940,0migration/327885-21kthreadcore11:25:523
339940,0migration/317545-21ntp_kernel_pll_07:45:523
339940,0migration/314701-21kthreadcore08:10:493
29725040,0irq/27-eth0-tx-653-21munin-node10:30:442
29725040,0irq/27-eth0-tx-5418-21munin-node07:40:470
29725040,0irq/27-eth0-tx-31617-21sshd10:26:512
29725040,0irq/27-eth0-tx-17223-21ssh10:20:402
29725040,0irq/27-eth0-tx-1308-21munin-node10:10:442
29725040,0irq/27-eth0-tx-0-21swapper/210:45:432
29725040,0irq/27-eth0-tx-0-21swapper/209:46:592
29725040,0irq/27-eth0-tx-0-21swapper/209:35:342
29725040,0irq/27-eth0-tx-0-21swapper/008:17:530
29725040,0irq/27-eth0-tx-0-21swapper/008:00:470
29725040,0irq/27-eth0-tx-0-21swapper/007:30:470
29715040,0irq/26-eth0-rx-5360-21ssh11:52:333
29715040,0irq/26-eth0-rx-0-21swapper/312:12:283
29715040,0irq/26-eth0-rx-0-21swapper/312:08:023
29715040,0irq/26-eth0-rx-0-21swapper/311:42:113
29715040,0irq/26-eth0-rx-0-21swapper/311:11:373
29715040,0irq/26-eth0-rx-0-21swapper/310:55:453
29715040,0irq/26-eth0-rx-0-21swapper/310:30:493
29715040,0irq/26-eth0-rx-0-21swapper/309:50:453
29715040,0irq/26-eth0-rx-0-21swapper/309:41:413
29715040,0irq/26-eth0-rx-0-21swapper/307:35:473
289339944,0cyclictest0-21swapper/208:46:252
289339943,0cyclictest4286-21awk06:50:482
289339943,0cyclictest3556-21lldpd07:00:472
289339943,0cyclictest3514-21snmpd08:13:302
289339943,0cyclictest3514-21snmpd08:02:302
289339943,0cyclictest21562-21awk08:40:472
289329944,0cyclictest0-21swapper/110:04:341
289329943,0cyclictest8635-21awk11:15:451
289329943,0cyclictest8635-21awk11:15:451
289329943,0cyclictest6298-21awk07:40:481
289329943,0cyclictest3751-21awk08:50:481
289329943,0cyclictest3556-21lldpd11:00:481
289329943,0cyclictest3556-21lldpd08:20:171
289329943,0cyclictest3556-21lldpd06:55:471
289329943,0cyclictest31428-21awk12:10:461
289329943,0cyclictest29978-21awk06:45:461
289329943,0cyclictest28034-21awk09:05:451
289329943,0cyclictest23421-21awk12:05:461
289329943,0cyclictest18651-21awk07:25:481
289329943,0cyclictest17658-21awk10:40:481
289329943,0cyclictest1551-21awk10:30:451
289329943,0cyclictest12023-21awk07:20:481
289319943,0cyclictest8322-21awk08:30:480
289319943,0cyclictest3844-21awk08:50:490
289319943,0cyclictest3556-21lldpd08:12:470
289319943,0cyclictest3514-21snmpd08:35:450
289319943,0cyclictest3241-21irqbalance10:49:510
289319943,0cyclictest3241-21irqbalance10:31:010
289319943,0cyclictest3129-21awk09:30:470
289319943,0cyclictest26999-21awk09:45:440
289319943,0cyclictest19624-21awk07:50:470
289319943,0cyclictest10215-21awk10:15:480
259940,0migration/29448-21kthreadcore07:15:502
259940,0migration/224157-21irqcore11:45:472
259940,0migration/224144-21gltestperf07:05:462
259940,0migration/213429-21kthreadcore09:55:502
249940,0watchdog/28248-21if_err_eth1.308:30:472
249940,0watchdog/224455-21munin-node07:30:432
249940,0watchdog/215466-21missed_timers06:55:522
249940,0watchdog/20-21swapper/209:10:472
19140,0ktimersoftd/10-21swapper/112:04:521
179940,0migration/19594-21taskset06:52:171
179940,0migration/15267-21munin-node07:15:471
179940,0migration/13606-21irqstats09:30:481
179940,0migration/131432-21kthreadcore09:25:501
179940,0migration/130911-21kthreadcore09:45:471
179940,0migration/129206-21kthreadcore10:25:511
179940,0migration/125193-21kthreadcore11:45:481
179940,0migration/124022-21fschecks_time07:05:461
179940,0migration/119859-21irqcore07:50:491
179940,0migration/119134-21taskset08:11:551
179940,0migration/11572-21sh10:10:441
179940,0migration/112934-21kthreadcore10:55:491
179940,0migration/111996-21runrttasks08:05:521
179940,0migration/110481-21cpuspeed_turbos09:35:441
169940,0watchdog/19255-21ssh09:54:431
169940,0watchdog/16024-21kthreadcore09:10:471
169940,0watchdog/14636-21kthreadcore08:25:511
169940,0watchdog/132504-21tune2fs08:00:471
169940,0watchdog/130632-21ssh11:06:511
169940,0watchdog/127120-21diskmemload11:20:471
169940,0watchdog/121573-21rm11:41:541
169940,0watchdog/119547-21chrt09:20:471
169940,0watchdog/112909-21ssh11:56:141
169940,0watchdog/110596-21smartctl09:55:471
169940,0watchdog/10-21swapper/111:30:471
169940,0watchdog/10-21swapper/111:10:511
169940,0watchdog/10-21swapper/110:15:471
169940,0watchdog/10-21swapper/108:47:111
149940,0migration/03700-21kthreadcore11:50:510
149940,0migration/028423-21kthreadcore09:25:480
149940,0migration/021887-21kthreadcore09:00:490
149940,0migration/020294-21kthreadcore11:20:470
149940,0migration/019141-21kthreadcore10:20:490
149940,0migration/01281-21kthreadcore07:35:490
29715030,0irq/26-eth0-rx-0-21swapper/308:42:343
29715030,0irq/26-eth0-rx-0-21swapper/308:25:453
29715030,0irq/26-eth0-rx-0-21swapper/308:05:433
29715030,0irq/26-eth0-rx-0-21swapper/307:55:433
29715030,0irq/26-eth0-rx-0-21swapper/307:50:433
29715030,0irq/26-eth0-rx-0-21swapper/307:03:123
289339933,0cyclictest3556-21lldpd07:36:472
289339932,0cyclictest7265-21awk08:05:472
289339932,0cyclictest3556-21lldpd07:45:472
289339932,0cyclictest3556-21lldpd06:45:462
289339932,0cyclictest2833-21grep07:10:512
289339932,0cyclictest20169-21fschecks_count08:15:462
289339932,0cyclictest19399-21grep07:50:462
289339931,0cyclictest28930-21cyclictest07:40:502
289329932,0cyclictest8219-21awk08:30:471
289329932,0cyclictest3556-21lldpd07:30:471
289329932,0cyclictest21617-21awk08:40:471
289329932,0cyclictest19980-21cut07:00:501
289329932,0cyclictest19865-21cat09:00:461
289329932,0cyclictest14926-21awk08:35:481
289329932,0cyclictest12246-21cpu07:45:451
289329930,0cyclictest26045-21perl07:55:461
289319933,0cyclictest4770-21kworker/0:206:55:390
289319933,0cyclictest17563-21kworker/0:112:05:360
289319933,0cyclictest17563-21kworker/0:111:45:380
289319933,0cyclictest17563-21kworker/0:111:35:360
289319933,0cyclictest17563-21kworker/0:110:55:420
289319933,0cyclictest17563-21kworker/0:109:05:340
289319933,0cyclictest17563-21kworker/0:108:05:390
289319933,0cyclictest17563-21kworker/0:107:15:390
249930,0watchdog/20-21swapper/207:55:552
179930,0migration/1310-21kthreadcore07:10:501
169930,0watchdog/127120-21diskmemload09:16:471
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional