You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 03:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Fri Jun 12, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1458624031,0sleep10-21swapper/119:23:371
1447423927,0sleep20-21swapper/219:22:182
1435923725,0sleep00-21swapper/019:20:560
1446523223,0sleep30-21swapper/319:22:113
14779991111,0cyclictest3524-21snmpd21:55:060
147819970,0cyclictest0-21swapper/222:35:202
339960,0migration/36898-21munin-node23:05:193
339960,0migration/332190-21gltestperf23:20:143
339960,0migration/33029-21ntp_offset19:35:203
339960,0migration/321748-21sh00:26:343
339960,0migration/321409-21sh21:57:233
339960,0migration/319325-21sh00:06:233
339960,0migration/316967-21sh22:32:053
29805060,0irq/28-eth0-rx-26535-21irqstats23:35:183
29805060,0irq/28-eth0-rx-0-21swapper/321:43:333
147819960,0cyclictest0-21swapper/223:11:162
147799960,0cyclictest0-21swapper/022:28:450
149960,0migration/07713-21sh00:39:080
149960,0migration/01555-21sh23:55:320
149960,0migration/012913-21kthreadcore23:45:180
339950,0migration/38239-21latency_hist00:40:013
339950,0migration/36749-21kthreadcore00:00:183
339950,0migration/34075-21fschecks_time22:45:153
339950,0migration/33978-21kthreadcore22:05:183
339950,0migration/33595-21switchtime20:20:253
339950,0migration/328224-21kthreadcore20:40:163
339950,0migration/328060-21munin-node22:40:213
339950,0migration/326317-21kthreadcore20:15:173
339950,0migration/325750-21kthreadcore00:10:193
339950,0migration/325725-21kthreadcore21:00:173
339950,0migration/321336-21munin-node20:10:203
339950,0migration/314766-21kthreadcore20:30:173
329950,0watchdog/39194-21kthreadcore21:50:193
329950,0watchdog/35999-21sh00:35:243
329950,0watchdog/35086-21seq00:18:243
329950,0watchdog/331954-21cut21:25:193
329950,0watchdog/321078-21fschecks_count22:55:153
329950,0watchdog/318174-21python22:50:233
329950,0watchdog/316188-21iostat_ios19:25:153
329950,0watchdog/311277-21kthreadcore00:20:203
329950,0watchdog/30-21swapper/323:30:203
29815050,0irq/29-eth0-tx-6481-21ssh22:07:502
29815050,0irq/29-eth0-tx-3159-21munin-node22:45:242
29815050,0irq/29-eth0-tx-24838-21munin-node22:20:262
29815050,0irq/29-eth0-tx-20327-21cut23:50:182
29815050,0irq/29-eth0-tx-18956-21munin-node20:35:210
29815050,0irq/29-eth0-tx-15237-21munin-node20:10:210
29815050,0irq/29-eth0-tx-0-21swapper/223:28:592
29815050,0irq/29-eth0-tx-0-21swapper/021:25:230
29815050,0irq/29-eth0-tx-0-21swapper/020:44:540
29815050,0irq/29-eth0-tx-0-21swapper/019:44:450
29805050,0irq/28-eth0-rx-9694-21idleruntime-cro23:45:013
29805050,0irq/28-eth0-rx-8300-21fschecks_time22:10:133
29805050,0irq/28-eth0-rx-6314-21runrttasks23:45:113
29805050,0irq/28-eth0-rx-26917-21cut22:20:183
29805050,0irq/28-eth0-rx-2653-21needreboot23:00:223
29805050,0irq/28-eth0-rx-22386-21kthreadcore20:35:173
29805050,0irq/28-eth0-rx-13903-21kthreadcore21:35:183
29805050,0irq/28-eth0-rx-0-21swapper/323:55:083
29805050,0irq/28-eth0-rx-0-21swapper/323:50:193
29805050,0irq/28-eth0-rx-0-21swapper/323:27:233
29805050,0irq/28-eth0-rx-0-21swapper/323:15:183
29805050,0irq/28-eth0-rx-0-21swapper/323:10:193
29805050,0irq/28-eth0-rx-0-21swapper/322:35:193
29805050,0irq/28-eth0-rx-0-21swapper/322:00:113
29805050,0irq/28-eth0-rx-0-21swapper/321:33:303
29805050,0irq/28-eth0-rx-0-21swapper/300:47:243
259950,0migration/224064-21kthreadcore21:20:162
259950,0migration/218301-21timerandwakeup21:15:252
249950,0watchdog/215895-21grep23:45:202
19150,0ktimersoftd/10-21swapper/123:38:491
179950,0migration/132425-21sh23:20:161
179950,0migration/13173-21kthreadcore22:25:171
179950,0migration/127884-21fschecks_time23:55:161
179950,0migration/121809-21kthreadcore21:20:151
179950,0migration/120530-21munin-node22:55:131
179950,0migration/11893-21kthreadcore19:35:181
179950,0migration/117462-21kthreadcore20:55:161
147819955,0cyclictest26124-21diskmemload22:17:122
147819950,0cyclictest0-21swapper/223:57:562
147819950,0cyclictest0-21swapper/222:50:562
147819950,0cyclictest0-21swapper/221:58:452
147819950,0cyclictest0-21swapper/221:25:482
147819950,0cyclictest0-21swapper/200:49:012
147809950,0cyclictest0-21swapper/100:16:581
149950,0migration/07652-21kthreadcore00:00:190
149950,0migration/06701-21sh22:08:250
149950,0migration/06514-21kthreadcore23:40:190
149950,0migration/05655-21sh23:20:320
149950,0migration/04465-21kthreadcore20:00:180
149950,0migration/030259-21sh23:00:180
149950,0migration/030131-21fschecks_time19:35:130
149950,0migration/028754-21pmu-power23:15:210
149950,0migration/027252-21runrttasks21:41:260
149950,0migration/025914-21cpuspeed_turbos00:50:140
149950,0migration/024620-21sh00:48:010
149950,0migration/024297-21kthreadcore00:10:180
149950,0migration/024155-21irqrtprio22:00:150
149950,0migration/023900-21kthreadcore19:30:170
149950,0migration/023501-21fschecks_time21:00:130
149950,0migration/022299-21taskset00:28:030
149950,0migration/019298-21idleruntime22:35:150
149950,0migration/018993-21kthreadcore22:15:190
149950,0migration/018414-21taskset19:49:030
149950,0migration/018060-21proc_pri22:50:220
149950,0migration/017079-21fschecks_time23:30:140
149950,0migration/016200-21fschecks_time20:55:130
149950,0migration/015726-21kthreadcore23:10:190
149950,0migration/014160-21unixbench_multi22:10:250
149950,0migration/013771-21kthreadcore20:30:170
149950,0migration/013697-21sh00:23:160
149950,0migration/012835-21fschecks_count00:05:140
149950,0migration/012711-21kthreadcore23:25:180
149950,0migration/011259-21latency_hist21:35:000
149950,0migration/010735-21idleruntime22:30:160
8305040,0irq/26-0000:00:27576-21kthreadcore00:50:212
339940,0migration/39671-21kthreadcore21:10:173
339940,0migration/38389-21kthreadcore20:25:173
339940,0migration/329105-21kthreadcore19:55:173
339940,0migration/328822-21taskset19:31:163
339940,0migration/316543-21kthreadcore19:45:173
329940,0watchdog/322015-21kthreadcore21:20:153
329940,0watchdog/30-21swapper/321:15:113
329940,0watchdog/30-21swapper/320:45:153
329940,0watchdog/30-21swapper/319:54:473
29815040,0irq/29-eth0-tx-29052-21munin-node23:00:252
29815040,0irq/29-eth0-tx-23056-21fschecks_count23:15:132
29815040,0irq/29-eth0-tx-14766-21telnet00:25:122
29815040,0irq/29-eth0-tx-14539-21kthreadcore00:05:172
29815040,0irq/29-eth0-tx-11328-21munin-node21:35:162
29815040,0irq/29-eth0-tx-0-21swapper/223:35:232
29815040,0irq/29-eth0-tx-0-21swapper/222:00:072
29815040,0irq/29-eth0-tx-0-21swapper/221:30:272
29815040,0irq/29-eth0-tx-0-21swapper/200:31:052
29815040,0irq/29-eth0-tx-0-21swapper/200:15:122
29815040,0irq/29-eth0-tx-0-21swapper/200:00:022
29815040,0irq/29-eth0-tx-0-21swapper/021:15:230
29815040,0irq/29-eth0-tx-0-21swapper/020:15:200
29805040,0irq/28-eth0-rx-0-21swapper/322:25:343
29805040,0irq/28-eth0-rx-0-21swapper/322:15:183
29805040,0irq/28-eth0-rx-0-21swapper/321:45:073
29805040,0irq/28-eth0-rx-0-21swapper/320:50:173
29805040,0irq/28-eth0-rx-0-21swapper/319:40:163
29805040,0irq/28-eth0-rx-0-21swapper/300:52:513
29805040,0irq/28-eth0-rx-0-21swapper/300:31:153
27140,0ktimersoftd/20-21swapper/220:58:502
259940,0migration/28611-21kthreadcore21:10:172
259940,0migration/24053-21kthreadcore00:35:192
259940,0migration/232028-21kthreadcore21:45:182
259940,0migration/231047-21kthreadcore20:40:162
259940,0migration/22906-21latency_hist22:45:002
259940,0migration/22788-21kthreadcore20:00:172
259940,0migration/223976-21kthreadcore21:40:192
259940,0migration/22227-21munin-node22:25:162
259940,0migration/220313-21latency_hist22:55:002
259940,0migration/21929-21fschecks_time23:40:132
259940,0migration/214217-21kthreadcore22:30:192
259940,0migration/21367-21kthreadcore21:05:172
259940,0migration/210913-21kthreadcore00:20:202
249940,0watchdog/28056-21munin-node20:05:152
249940,0watchdog/220239-21kthreadcore23:30:202
249940,0watchdog/20-21swapper/223:05:192
249940,0watchdog/20-21swapper/219:45:112
179940,0migration/19179-21kthreadcore00:00:191
179940,0migration/18728-21fschecks_time20:05:121
179940,0migration/16604-21kthreadcore20:45:181
179940,0migration/15989-21fschecks_time23:05:151
179940,0migration/15725-21irqrtprio19:40:151
179940,0migration/15573-21fschecks_time21:10:131
179940,0migration/14889-21kthreadcore00:35:191
179940,0migration/14141-21runrttasks21:05:461
179940,0migration/14101-21irqrtprio21:30:181
179940,0migration/131968-21kthreadcore21:45:181
179940,0migration/130608-21kthreadcore19:55:181
179940,0migration/129214-21kthreadcore21:25:181
179940,0migration/125541-21latency_hist00:50:011
179940,0migration/123730-21kthreadcore21:40:191
179940,0migration/120161-21kernelversion23:50:181
179940,0migration/115749-21kthreadcore00:05:181
179940,0migration/115705-21kthreadcore21:35:181
179940,0migration/114247-21cpuspeed_turbos21:55:131
179940,0migration/113923-21kthreadcore20:30:171
179940,0migration/11226-21kthreadcore20:20:181
179940,0migration/110702-21kthreadcore00:40:171
179940,0migration/110670-21kthreadcore22:10:171
169940,0watchdog/16869-21ssh22:08:511
169940,0watchdog/15543-21kthreadcore22:45:191
169940,0watchdog/123282-21cut22:00:111
169940,0watchdog/123169-21ssh22:16:031
169940,0watchdog/113134-21ssh00:21:441
169940,0watchdog/10-21swapper/123:30:201
169940,0watchdog/10-21swapper/122:30:191
169940,0watchdog/10-21swapper/120:40:231
147819943,0cyclictest9439-21awk00:40:152
147819943,0cyclictest7626-21cut22:10:112
147819943,0cyclictest6531-21awk21:50:172
147819943,0cyclictest5637-21awk20:25:152
147819943,0cyclictest3571-21lldpd20:35:422
147819943,0cyclictest3571-21lldpd00:10:152
147819943,0cyclictest3524-21snmpd23:21:062
147819943,0cyclictest3524-21snmpd19:54:482
147819943,0cyclictest3250-21irqbalance20:20:162
147819943,0cyclictest3250-21irqbalance20:15:062
147819943,0cyclictest3250-21irqbalance19:40:062
147819943,0cyclictest3250-21irqbalance19:35:162
147819943,0cyclictest3250-21irqbalance19:30:362
147819943,0cyclictest3250-21irqbalance19:26:562
147809944,0cyclictest0-21swapper/123:15:101
147809944,0cyclictest0-21swapper/122:43:101
147809944,0cyclictest0-21swapper/100:10:211
147809943,0cyclictest3571-21lldpd20:18:411
147809943,0cyclictest3571-21lldpd19:47:411
147809943,0cyclictest3524-21snmpd23:40:061
147809943,0cyclictest3524-21snmpd20:13:041
147809943,0cyclictest30184-21awk23:00:181
147809943,0cyclictest24357-21awk00:30:161
147809943,0cyclictest1950-21grep20:00:171
147809943,0cyclictest19390-21awk22:35:171
147809943,0cyclictest15076-21awk23:10:171
147809943,0cyclictest13132-21awk21:15:151
147809943,0cyclictest10758-21grep23:45:131
147809940,0cyclictest0-21swapper/100:47:151
147799943,0cyclictest9512-21awk00:40:160
147799943,0cyclictest6463-21awk23:05:180
147799943,0cyclictest5819-21awk21:10:140
147799943,0cyclictest3636-21awk21:30:170
147799943,0cyclictest3571-21lldpd00:16:450
147799943,0cyclictest3524-21snmpd21:05:190
147799943,0cyclictest3524-21snmpd19:50:180
147799943,0cyclictest27016-21awk19:55:150
147799943,0cyclictest21518-21awk22:55:170
149940,0migration/08100-21kthreadcore22:45:200
149940,0migration/06743-21kthreadcore20:25:160
149940,0migration/05173-21latency_hist21:50:000
149940,0migration/031978-21sh23:36:250
149940,0migration/013145-21kthreadcore20:50:170
329930,0watchdog/30-21swapper/320:00:113
29815030,0irq/29-eth0-tx-29807-21aten2.4-expect20:20:120
29815030,0irq/29-eth0-tx-0-21swapper/020:05:100
29805030,0irq/28-eth0-rx-0-21swapper/321:05:243
29805030,0irq/28-eth0-rx-0-21swapper/320:55:133
29805030,0irq/28-eth0-rx-0-21swapper/320:05:103
169930,0watchdog/10-21swapper/123:25:111
169930,0watchdog/10-21swapper/121:50:191
147819933,0cyclictest3571-21lldpd20:45:122
147819932,0cyclictest3571-21lldpd21:00:122
147819932,0cyclictest3571-21lldpd20:50:122
147819932,0cyclictest3571-21lldpd19:58:412
147819932,0cyclictest17956-21sensors20:30:222
147819932,0cyclictest16413-21awk20:10:152
147809932,0cyclictest9319-21awk20:50:151
147809932,0cyclictest5846-21cut20:25:161
147809932,0cyclictest3524-21snmpd22:50:161
147809932,0cyclictest3524-21snmpd22:20:111
147809932,0cyclictest3524-21snmpd20:35:191
147809932,0cyclictest23580-21sed19:30:171
147809932,0cyclictest21184-21sensors19:25:201
147809932,0cyclictest14771-21cyclictest00:25:181
147809930,0cyclictest23440-21perl21:00:131
147799933,0cyclictest3571-21lldpd00:32:150
147799932,0cyclictest3524-21snmpd20:49:550
147799932,0cyclictest25988-21awk22:20:160
147799932,0cyclictest11948-21tail21:50:270
147799930,0cyclictest0-21swapper/021:20:100
169920,0watchdog/10-21swapper/119:50:031
147799921,0cyclictest0-21swapper/023:50:110
147799920,0cyclictest0-21swapper/022:40:050
147799920,0cyclictest0-21swapper/019:25:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional