You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 04:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Jul 07, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
271730,0ktimersoftd/2780-21perf19:26:512
784824938,0sleep00-21swapper/019:24:510
766724435,0sleep10-21swapper/119:22:441
790423929,0sleep30-21swapper/319:25:343
80999977,0cyclictest24650-21sensors22:07:242
80999960,0cyclictest0-21swapper/221:02:172
80969960,0cyclictest0-21swapper/121:27:211
80949965,0cyclictest14682-21munin-run23:57:030
80949960,0cyclictest0-21swapper/023:49:130
80949960,0cyclictest0-21swapper/023:35:200
339960,0migration/39616-21sh00:28:563
339960,0migration/34264-21sh19:47:223
339960,0migration/331724-21sh21:53:333
339960,0migration/329936-21munin-node19:42:303
339960,0migration/326749-21ntp_offset22:27:203
339960,0migration/322565-21sh22:46:393
339960,0migration/319040-21sh22:23:223
339960,0migration/314299-21sh00:54:563
329960,0watchdog/35498-21fschecks_time00:47:183
329960,0watchdog/320977-21tr21:07:213
29805060,0irq/28-eth0-rx-30088-21cut23:07:203
29805060,0irq/28-eth0-rx-21290-21python23:57:263
27160,0ktimersoftd/20-21swapper/200:22:212
259960,0migration/27818-21sh00:10:462
149960,0migration/030328-21latency_hist21:37:020
80999954,0cyclictest3524-21snmpd22:38:242
80999954,0cyclictest2989-21awk20:12:182
80969950,0cyclictest0-21swapper/121:46:261
80949955,0cyclictest0-21swapper/022:54:120
80949950,0cyclictest0-21swapper/023:04:450
80949950,0cyclictest0-21swapper/022:34:010
80949950,0cyclictest0-21swapper/022:01:320
4150,0ktimersoftd/00-21swapper/022:29:550
4150,0ktimersoftd/00-21swapper/000:40:370
4150,0ktimersoftd/00-21swapper/000:40:370
339950,0migration/39063-21aten2.4-expect19:32:123
339950,0migration/38367-21taskset19:27:473
339950,0migration/33732-21kthreadcore23:12:253
339950,0migration/332752-21munin-node22:52:173
339950,0migration/330958-21kthreadcore22:12:223
339950,0migration/327844-21fschecks_time20:07:153
339950,0migration/32733-21kthreadcore20:32:233
339950,0migration/325920-21latency20:47:203
339950,0migration/324971-21irqcore00:02:193
339950,0migration/322805-21kthreadcore22:07:203
339950,0migration/322645-21needreboot23:02:223
339950,0migration/321974-21kthreadcore20:02:173
339950,0migration/318392-21kthreadcore19:57:203
339950,0migration/318315-21idleruntime00:17:173
339950,0migration/315050-21switchtime00:12:293
339950,0migration/313019-21kthreadcore00:32:203
339950,0migration/312961-21aten_r1power_cu20:42:143
339950,0migration/312218-21timerwakeupswit22:37:273
339950,0migration/311387-21kthreadcore20:17:203
339950,0migration/310516-21fschecks_time22:02:163
339950,0migration/310055-21sh22:17:333
329950,0watchdog/331174-21perl21:37:173
329950,0watchdog/329061-21tune2fs00:42:183
329950,0watchdog/32843-21perl20:12:173
329950,0watchdog/322084-21pmu-power21:47:253
329950,0watchdog/319994-21if_err_eth023:22:183
329950,0watchdog/319376-21ssh23:37:343
329950,0watchdog/317992-21cut19:37:213
329950,0watchdog/31791-21ssh22:32:213
29815050,0irq/29-eth0-tx-31547-21kthreadcore23:47:212
29815050,0irq/29-eth0-tx-29935-21grep23:07:202
29815050,0irq/29-eth0-tx-28333-21munin-node00:42:272
29815050,0irq/29-eth0-tx-27347-21munin-node20:52:190
29815050,0irq/29-eth0-tx-24522-21ssh23:05:482
29815050,0irq/29-eth0-tx-10872-21ssh23:32:562
29815050,0irq/29-eth0-tx-0-21swapper/222:57:052
29815050,0irq/29-eth0-tx-0-21swapper/222:47:292
29815050,0irq/29-eth0-tx-0-21swapper/200:37:522
29815050,0irq/29-eth0-tx-0-21swapper/200:37:522
29815050,0irq/29-eth0-tx-0-21swapper/200:03:492
29815050,0irq/29-eth0-tx-0-21swapper/200:00:482
29815050,0irq/29-eth0-tx-0-21swapper/020:57:150
29805050,0irq/28-eth0-rx-8035-21tr23:52:203
29805050,0irq/28-eth0-rx-5759-21kthreadcore00:07:223
29805050,0irq/28-eth0-rx-4932-21python21:17:293
29805050,0irq/28-eth0-rx-31937-21munin-node00:22:233
29805050,0irq/28-eth0-rx-31255-21ssh22:51:433
29805050,0irq/28-eth0-rx-24858-21kthreadcore23:42:243
29805050,0irq/28-eth0-rx-12805-21cut22:57:213
29805050,0irq/28-eth0-rx-0-21swapper/323:29:443
29805050,0irq/28-eth0-rx-0-21swapper/323:17:203
29805050,0irq/28-eth0-rx-0-21swapper/321:42:193
29805050,0irq/28-eth0-rx-0-21swapper/321:32:153
29805050,0irq/28-eth0-rx-0-21swapper/321:02:213
259950,0migration/25946-21kthreadcore00:27:212
259950,0migration/229590-21cpuspeed_turbos22:32:152
259950,0migration/224681-21kthreadcore23:22:212
259950,0migration/223075-21unixbench-2d21:07:282
259950,0migration/215684-21needreboot22:02:222
259950,0migration/212191-21kthreadcore20:17:202
249950,0watchdog/25496-21fschecks_time00:47:182
249950,0watchdog/223787-21munin-node20:27:132
179950,0migration/17717-21runrttasks00:10:291
179950,0migration/131661-21kthreadcore23:47:201
179950,0migration/128917-21sh23:45:011
179950,0migration/127207-21sh22:12:161
179950,0migration/114524-21aten2.4-expect22:42:161
179950,0migration/111550-21kthreadcore19:32:181
179950,0migration/111445-21sh22:21:221
149950,0migration/09285-21kthreadcore20:37:210
149950,0migration/06548-21fschecks_count21:22:160
149950,0migration/05715-21kthreadcore23:12:260
149950,0migration/032426-21switchtime00:22:290
149950,0migration/029792-21latency_hist23:47:030
149950,0migration/026945-21taskset20:50:100
149950,0migration/019019-21sh22:23:200
149950,0migration/018585-21cpuspeed_turbos22:07:140
149950,0migration/016397-21kthreadcore19:57:200
149950,0migration/015951-21sh23:00:550
149950,0migration/014902-21kthreadcore20:42:200
149950,0migration/014169-21sh21:43:330
149950,0migration/011140-21kthreadcore21:02:200
8305040,0irq/26-0000:00:24524-21latency_hist21:52:022
8305040,0irq/26-0000:00:0-21swapper/222:17:022
8305040,0irq/26-0000:00:0-21swapper/200:32:032
80999943,0cyclictest8086-21awk21:42:162
80999943,0cyclictest6543-21awk19:52:172
80999943,0cyclictest3571-21lldpd23:37:062
80999943,0cyclictest3571-21lldpd21:15:332
80999943,0cyclictest3524-21snmpd22:27:092
80999943,0cyclictest3524-21snmpd20:25:232
80999943,0cyclictest3524-21snmpd19:44:232
80999943,0cyclictest3524-21snmpd19:33:222
80999943,0cyclictest3524-21snmpd19:27:522
80999943,0cyclictest28309-21awk20:07:182
80999943,0cyclictest28051-21awk22:12:192
80999943,0cyclictest21021-21awk20:02:152
80999940,0cyclictest0-21swapper/222:53:172
80969944,0cyclictest0-21swapper/122:23:381
80969944,0cyclictest0-21swapper/122:02:121
80969944,0cyclictest0-21swapper/122:01:241
80969944,0cyclictest0-21swapper/120:47:281
80969943,0cyclictest3571-21lldpd21:22:031
80969943,0cyclictest3571-21lldpd21:02:031
80969943,0cyclictest3571-21lldpd20:20:311
80969943,0cyclictest3571-21lldpd20:12:311
80969943,0cyclictest3571-21lldpd20:09:311
80969943,0cyclictest3571-21lldpd19:30:301
80969943,0cyclictest3571-21lldpd00:43:371
80969943,0cyclictest3571-21lldpd00:22:061
80969943,0cyclictest3524-21snmpd23:19:091
80969943,0cyclictest3524-21snmpd00:32:251
80969943,0cyclictest24781-21awk20:27:171
80969943,0cyclictest24428-21awk19:42:181
80969943,0cyclictest17067-21awk21:47:201
80949944,0cyclictest0-21swapper/022:44:060
80949944,0cyclictest0-21swapper/019:32:040
80949944,0cyclictest0-21swapper/000:48:110
80949943,0cyclictest982-21awk00:07:190
80949943,0cyclictest5492-21sadc20:37:020
80949943,0cyclictest4388-21awk22:17:180
80949943,0cyclictest3571-21lldpd21:54:040
80949943,0cyclictest3524-21snmpd19:40:080
80949943,0cyclictest3250-21irqbalance23:37:190
80949943,0cyclictest3250-21irqbalance23:30:090
80949943,0cyclictest3250-21irqbalance23:22:190
80949943,0cyclictest3250-21irqbalance23:18:390
80949943,0cyclictest3250-21irqbalance22:37:090
80949943,0cyclictest3250-21irqbalance21:27:590
80949943,0cyclictest3250-21irqbalance21:18:290
80949943,0cyclictest3250-21irqbalance21:12:190
80949943,0cyclictest3250-21irqbalance21:07:080
80949943,0cyclictest3250-21irqbalance00:02:290
80949943,0cyclictest28082-21awk22:12:190
80949943,0cyclictest16081-21awk23:57:180
80949940,0cyclictest0-21swapper/019:42:100
339940,0migration/39625-21kthreadcore21:22:203
339940,0migration/35506-21kthreadcore21:57:203
329940,0watchdog/30-21swapper/323:47:223
329940,0watchdog/30-21swapper/321:27:173
329940,0watchdog/30-21swapper/320:37:213
29815040,0irq/29-eth0-tx-21269-21ssh23:42:102
29815040,0irq/29-eth0-tx-18364-21if_err_eth1.300:17:172
29815040,0irq/29-eth0-tx-16452-21munin-node20:22:180
29815040,0irq/29-eth0-tx-14328-21ssh22:42:092
29815040,0irq/29-eth0-tx-0-21swapper/223:52:342
29815040,0irq/29-eth0-tx-0-21swapper/223:28:262
29815040,0irq/29-eth0-tx-0-21swapper/222:22:112
29815040,0irq/29-eth0-tx-0-21swapper/221:59:172
29815040,0irq/29-eth0-tx-0-21swapper/221:47:042
29815040,0irq/29-eth0-tx-0-21swapper/221:37:132
29815040,0irq/29-eth0-tx-0-21swapper/221:32:182
29815040,0irq/29-eth0-tx-0-21swapper/200:52:042
29815040,0irq/29-eth0-tx-0-21swapper/200:12:042
29805040,0irq/28-eth0-rx-9049-21sshd21:00:283
29805040,0irq/28-eth0-rx-0-21swapper/323:32:153
29805040,0irq/28-eth0-rx-0-21swapper/300:37:083
29805040,0irq/28-eth0-rx-0-21swapper/300:37:083
259940,0migration/29354-21kthreadcore20:37:212
259940,0migration/23327-21kthreadcore20:32:232
259940,0migration/231052-21munin-node21:17:142
259940,0migration/214841-21kthreadcore21:27:202
259940,0migration/212812-21aten_r1power_po19:57:142
259940,0migration/212664-21kthreadcore23:17:202
249940,0watchdog/24232-21kthreadcore23:12:262
249940,0watchdog/217305-21kthreadcore20:42:212
249940,0watchdog/21137-21python20:52:252
179940,0migration/19097-21vmstat00:27:291
179940,0migration/18154-21kthreadcore23:52:201
179940,0migration/17218-21kthreadcore23:32:211
179940,0migration/15457-21runrttasks19:52:081
179940,0migration/130427-21runrttasks21:12:581
179940,0migration/126767-21taskset00:38:321
179940,0migration/126767-21taskset00:38:321
179940,0migration/126073-21fschecks_time23:07:161
179940,0migration/123089-21irqrtprio21:32:191
179940,0migration/123003-21kthreadcore22:07:201
179940,0migration/122038-21kthreadcore20:22:201
179940,0migration/120530-21latency_hist22:27:021
179940,0migration/117527-21cpuspeed_turbos00:17:141
179940,0migration/114936-21kthreadcore19:57:191
179940,0migration/11421-21kthreadcore20:32:221
169940,0watchdog/18861-21kthreadcore20:37:211
169940,0watchdog/17231-21ssh22:55:451
169940,0watchdog/16783-21if_eth122:37:171
169940,0watchdog/15499-21fschecks_time00:47:181
169940,0watchdog/13019-21kthreadcore21:17:211
169940,0watchdog/12382-21perl23:12:221
169940,0watchdog/12230-21kthreadcore22:32:211
169940,0watchdog/121566-21tr20:02:171
169940,0watchdog/120999-21netstat23:57:221
169940,0watchdog/119993-21sh23:22:181
169940,0watchdog/117306-21kthreadcore20:42:211
169940,0watchdog/115311-21users00:12:301
169940,0watchdog/113703-21ssh00:53:181
169940,0watchdog/10-21swapper/123:39:221
169940,0watchdog/10-21swapper/122:59:331
169940,0watchdog/10-21swapper/119:37:211
149940,0migration/08812-21cpu00:12:160
149940,0migration/07523-21kthreadcore00:27:210
149940,0migration/028295-21kthreadcore23:07:200
149940,0migration/026125-21kthreadcore22:47:210
149940,0migration/023282-21diskmemload00:17:210
149940,0migration/022837-21irqcore21:32:180
149940,0migration/014559-21kthreadcore22:02:200
149940,0migration/011558-21kthreadcore20:17:200
149940,0migration/011178-21aten_r1power_vo00:32:150
80999933,0cyclictest3571-21lldpd20:57:032
80999933,0cyclictest31747-21awk19:47:182
80999932,0cyclictest17232-21awk19:37:192
80999930,0cyclictest0-21swapper/220:51:252
80969933,0cyclictest3571-21lldpd23:02:051
80969933,0cyclictest3571-21lldpd21:01:331
80969932,0cyclictest3524-21snmpd20:52:081
80969930,0cyclictest3698-21tr19:47:201
80969930,0cyclictest31356-21perl21:37:171
80969930,0cyclictest17049-21df_inode21:07:161
80969930,0cyclictest0-21swapper/123:27:051
80949933,0cyclictest3571-21lldpd19:57:000
80949933,0cyclictest3571-21lldpd19:30:010
80949932,0cyclictest684-21open_files20:07:220
80949932,0cyclictest29388-21awk00:42:190
80949932,0cyclictest22233-21sensors21:47:260
80949932,0cyclictest13677-21ssh00:53:140
80949931,0cyclictest4063-21latency19:47:200
329930,0watchdog/30-21swapper/321:12:173
329930,0watchdog/30-21swapper/320:52:213
329930,0watchdog/30-21swapper/320:27:133
329930,0watchdog/30-21swapper/320:22:133
29815030,0irq/29-eth0-tx-0-21swapper/020:27:200
29815030,0irq/29-eth0-tx-0-21swapper/020:12:150
29815030,0irq/29-eth0-tx-0-21swapper/020:02:110
29805030,0irq/28-eth0-rx-0-21swapper/319:52:023
169930,0watchdog/126165-21kthreadcore22:47:211
169930,0watchdog/112921-21diskmemload21:52:051
169930,0watchdog/112921-21diskmemload00:04:301
80999920,0cyclictest5896-21latency_hist21:22:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional