You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 09:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot2.osadl.org (updated Wed Nov 05, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136383421120,2sleep30-21swapper/322:00:553
15352852960,2sleep20-21swapper/223:40:012
13721752470,2sleep11372177-21uname22:05:581
14194502430,1sleep11419453-21grep22:31:031
1131019992818,6cyclictest1803-21gdbus23:15:000
1131019992616,6cyclictest1362503-21cstates22:00:500
1131020992421,2cyclictest1604647-21latency_hist00:20:001
13850052230,2sleep20-21swapper/222:11:042
1131020992320,2cyclictest1151431-21ls19:25:011
1131019992214,7cyclictest1276999-21kthreadcore21:10:580
1131020992118,2cyclictest7602-21cron21:25:001
1131020992112,4cyclictest0-21swapper/121:40:011
113101999219,7cyclictest0-21swapper/023:00:480
1131019992118,2cyclictest1413702-21ls22:30:000
113101999211,16cyclictest0-21swapper/000:06:280
1131019992110,6cyclictest0-21swapper/021:40:020
12901242200,2sleep30-21swapper/321:16:503
1131021992018,1cyclictest0-21swapper/219:40:012
1131021992018,1cyclictest0-21swapper/219:15:022
1131020992017,2cyclictest1635-21dbus-daemon20:05:011
1131020992013,3cyclictest1535874-21/usr/sbin/munin23:40:571
1131019992013,3cyclictest1539981-21cut23:40:570
1131021991916,1cyclictest0-21swapper/221:25:012
1131020991916,2cyclictest1630897-21cron00:35:011
1131020991915,1cyclictest170550irq/121-eno123:35:011
1131020991913,2cyclictest1485339-21kthreadcore23:10:561
113101999193,9cyclictest1635-21dbus-daemon20:45:020
1131019991916,2cyclictest1300759-21unin-run21:25:010
1131019991913,5cyclictest1636883-21ssh00:36:000
1131019991913,5cyclictest1576967-21runrttasks00:02:230
1131019991912,6cyclictest1510636-21grep23:25:540
1131019991911,4cyclictest1624423-21kthreadcore00:30:560
1131019991910,5cyclictest1352693-21kworker/u16:0-rpciod22:15:540
1131019991910,4cyclictest1131017-21cyclictest22:08:370
302487291180,3phc2sys0-21swapper/300:38:303
302487291180,2phc2sys0-21swapper/323:29:103
1131020991816,1cyclictest0-21swapper/119:15:011
1131020991815,2cyclictest1131017-21cyclictest21:55:551
1131020991814,2cyclictest0-21swapper/100:00:021
113102099180,17cyclictest1431148-21kworker/1:1+mm_percpu_wq22:50:231
1131019991815,2cyclictest1483107-21cron23:10:010
1131019991815,2cyclictest1267616-21perf21:00:010
1131019991815,2cyclictest1267616-21perf21:00:010
113101999181,4cyclictest1387428-21idleruntime-cro22:15:000
1131019991814,3cyclictest1130914-21kworker/u16:3+nfsiod22:30:540
1131019991811,6cyclictest1434911-21kthreadcore22:41:010
113101999180,14cyclictest0-21swapper/019:10:540
302487291176,3phc2sys0-21swapper/323:13:113
302487291170,2phc2sys0-21swapper/323:55:553
302487291170,2phc2sys0-21swapper/323:47:493
113102199171,7cyclictest0-21swapper/221:55:502
1131021991714,1cyclictest0-21swapper/223:05:562
1131021991714,1cyclictest0-21swapper/222:25:012
1131021991714,1cyclictest0-21swapper/221:20:002
1131021991714,1cyclictest0-21swapper/220:10:012
1131021991714,1cyclictest0-21swapper/200:01:012
1131021991711,4cyclictest1411990-21taskset22:27:072
113102099179,3cyclictest0-21swapper/123:00:541
113102099178,4cyclictest0-21swapper/121:10:591
1131020991714,2cyclictest1500682-21cut23:20:011
1131020991714,2cyclictest1261499-21cron20:55:011
1131020991714,2cyclictest1224945-21apt-key20:25:001
1131020991714,2cyclictest1188009-21munin-plugin-st19:55:011
1131020991714,2cyclictest0-21swapper/120:00:011
1131020991710,5cyclictest1140278-21sort19:15:531
113101999178,5cyclictest1561913-21sort23:55:480
113101999178,2cyclictest0-21swapper/022:45:530
113101999176,6cyclictest0-21swapper/000:10:570
113101999173,8cyclictest1635-21dbus-daemon23:00:020
1131019991714,2cyclictest1700-21systemd-logind23:25:010
1131019991714,2cyclictest1220233-21irqrtprio20:20:580
1131019991713,2cyclictest0-21swapper/000:20:000
113101999170,16cyclictest1274614-21diskmemload22:52:350
302487291160,3phc2sys0-21swapper/322:33:583
302487291160,2phc2sys0-21swapper/323:50:293
302487291160,2phc2sys0-21swapper/300:20:463
1131021991614,1cyclictest0-21swapper/221:31:002
1131021991613,2cyclictest0-21swapper/219:15:312
1131021991613,1cyclictest0-21swapper/219:25:012
1131021991613,1cyclictest0-21swapper/200:25:162
1131021991612,2cyclictest0-21swapper/222:01:012
1131021991612,1cyclictest0-21swapper/220:45:532
113102199160,5cyclictest15675652sleep223:56:212
113102099169,6cyclictest1635-21dbus-daemon21:45:011
113102099169,5cyclictest1610545-21sshd00:21:001
1131020991613,2cyclictest8351-21rtkit-daemon00:08:081
1131020991613,2cyclictest1465845-21latency_hist23:00:011
1131020991613,2cyclictest0-21swapper/120:40:001
113102099161,13cyclictest1517929-21cat23:30:011
1131020991610,2cyclictest170550irq/121-eno122:15:571
113101999169,6cyclictest0-21swapper/023:16:020
113101999168,4cyclictest1552547-21kworker/u16:0-rpciod00:20:460
1131019991614,1cyclictest8351-21rtkit-daemon23:31:510
1131019991614,1cyclictest1361296-21tr22:00:000
1131019991613,2cyclictest1352839-21latency_hist21:55:010
1131019991613,2cyclictest1231198-21perf20:30:000
1131019991610,3cyclictest1274614-21diskmemload21:40:060
302487291158,3phc2sys0-21swapper/300:00:573
302487291150,2phc2sys0-21swapper/323:23:203
302487291150,2phc2sys0-21swapper/323:16:033
302487291150,2phc2sys0-21swapper/323:04:133
1131021991513,1cyclictest0-21swapper/221:40:022
1131021991512,1cyclictest0-21swapper/223:25:522
1131021991512,1cyclictest0-21swapper/223:10:562
1131021991512,1cyclictest0-21swapper/222:53:182
1131021991512,1cyclictest0-21swapper/222:50:002
1131021991512,1cyclictest0-21swapper/222:06:002
1131021991512,1cyclictest0-21swapper/221:10:002
1131021991512,1cyclictest0-21swapper/220:55:552
1131021991512,1cyclictest0-21swapper/220:55:552
1131021991512,1cyclictest0-21swapper/220:30:512
1131021991512,1cyclictest0-21swapper/200:40:012
1131021991511,2cyclictest0-21swapper/222:55:532
1131021991511,2cyclictest0-21swapper/222:41:092
1131021991511,1cyclictest0-21swapper/200:15:582
113102099158,3cyclictest1313007-21kthreadcore21:31:011
113102099154,6cyclictest0-21swapper/122:24:431
113102099153,2cyclictest351ktimers/120:15:271
1131020991512,2cyclictest1635-21dbus-daemon00:40:021
1131020991512,2cyclictest1622278-21sh00:30:011
1131020991512,2cyclictest1590863-21kthreadcore00:10:581
1131020991512,2cyclictest1506742-21unixbench_multi23:21:021
1131020991512,2cyclictest1362977-21if_enp1s022:00:531
1131020991512,2cyclictest1157592-21cut19:30:011
1131020991512,2cyclictest0-21swapper/121:00:021
1131020991512,2cyclictest0-21swapper/121:00:021
1131020991511,3cyclictest1549922-21timerwakeupswit23:46:011
1131020991511,3cyclictest1422447-21kworker/u16:2+nfsiod22:35:061
1131020991511,3cyclictest1130914-21kworker/u16:3+nfsiod22:29:021
1131020991511,3cyclictest1130914-21kworker/u16:3+nfsiod21:52:101
113101999158,6cyclictest1286787-21kthreadcore21:15:560
113101999157,4cyclictest1302770-21kthreadcore21:25:560
113101999154,2cyclictest491rcuog/223:50:010
1131019991513,1cyclictest8351-21rtkit-daemon20:12:140
1131019991512,2cyclictest1652-1atopacctd21:45:580
1131019991512,2cyclictest1652-1atopacctd21:45:580
1131019991512,2cyclictest1635-21dbus-daemon20:00:020
1131019991512,2cyclictest1635-21dbus-daemon00:30:010
1131019991512,2cyclictest1631-21gmain19:15:030
1131019991512,2cyclictest1272966-21kthreadcore21:05:520
1131019991512,2cyclictest1238220-21fschecks_time20:35:530
1131019991512,2cyclictest0-21swapper/023:55:010
1131019991511,3cyclictest1422447-21kworker/u16:2+nfsiod22:35:590
1131019991511,3cyclictest1130914-21kworker/u16:3+nfsiod23:39:330
302487291140,4phc2sys0-21swapper/322:45:563
302487291140,3phc2sys0-21swapper/321:10:513
302487291140,3phc2sys0-21swapper/300:10:073
302487291140,2phc2sys0-21swapper/321:38:003
302487291140,2phc2sys0-21swapper/321:34:493
302487291140,2phc2sys0-21swapper/321:27:563
302487291140,2phc2sys0-21swapper/300:26:453
113102199141,6cyclictest0-21swapper/223:50:512
1131021991412,1cyclictest0-21swapper/221:26:032
1131021991412,1cyclictest0-21swapper/221:10:592
1131021991412,1cyclictest0-21swapper/219:40:572
1131021991411,1cyclictest0-21swapper/223:15:572
1131021991411,1cyclictest0-21swapper/222:30:592
1131021991411,1cyclictest0-21swapper/220:05:012
1131021991411,1cyclictest0-21swapper/219:55:002
1131021991411,1cyclictest0-21swapper/219:45:542
1131021991411,1cyclictest0-21swapper/219:30:562
1131021991411,1cyclictest0-21swapper/219:30:012
1131021991411,1cyclictest0-21swapper/200:05:572
113102099148,2cyclictest170550irq/121-eno119:35:001
113102099144,3cyclictest170550irq/121-eno120:11:031
113102099141,3cyclictest0-21swapper/100:04:011
1131020991411,2cyclictest1726-21wpa_supplicant22:44:361
1131020991411,2cyclictest1479997-21latency23:05:571
1131020991411,2cyclictest1379607-21aten_repower_fr22:10:511
1131020991411,2cyclictest1237191-21cron20:35:001
1131020991411,2cyclictest1131017-21cyclictest19:45:461
1131020991410,3cyclictest1441578-21irqcore22:45:561
1131020991410,3cyclictest1244245-21fschecks_count20:40:561
113101999145,5cyclictest0-21swapper/019:25:030
113101999141,3cyclictest1237400-21munin-run20:35:010
1131019991411,2cyclictest1397408-21cpuspeed22:20:510
1131019991411,2cyclictest1313007-21kthreadcore21:31:000
1131019991411,2cyclictest1213155-21aten_repower_po20:15:540
1131019991411,2cyclictest1204811-21kthreadcore20:05:590
1131019991411,2cyclictest0-21swapper/019:55:010
1131019991410,3cyclictest1197360-21kthreadcore20:00:590
1131019991410,3cyclictest1177704-21kthreadcore19:45:560
113101999140,7cyclictest1249747-21cat20:45:490
302487291133,3phc2sys0-21swapper/321:41:043
302487291130,3phc2sys0-21swapper/322:25:313
302487291130,2phc2sys0-21swapper/322:21:523
113102199131,4cyclictest0-21swapper/220:00:012
1131021991311,1cyclictest0-21swapper/223:05:012
1131021991311,1cyclictest0-21swapper/221:05:012
1131021991311,1cyclictest0-21swapper/200:30:482
1131021991310,2cyclictest0-21swapper/220:16:012
1131021991310,1cyclictest0-21swapper/223:45:552
1131021991310,1cyclictest0-21swapper/223:40:572
1131021991310,1cyclictest0-21swapper/223:35:012
1131021991310,1cyclictest0-21swapper/223:20:492
1131021991310,1cyclictest0-21swapper/222:15:582
1131021991310,1cyclictest0-21swapper/221:50:562
1131021991310,1cyclictest0-21swapper/220:50:542
1131021991310,1cyclictest0-21swapper/220:35:512
1131021991310,1cyclictest0-21swapper/220:15:012
1131021991310,1cyclictest0-21swapper/200:20:572
1131021991310,1cyclictest0-21swapper/200:10:512
113102099139,3cyclictest1556811-21kthreadcore23:51:021
113102099137,2cyclictest170550irq/121-eno123:35:421
113102099133,4cyclictest1200953-21aten2.4-expect20:05:521
1131020991311,1cyclictest1301559-21aten2.4-expect21:25:501
1131020991310,2cyclictest1288771-21kthreadcore21:15:571
1131020991310,2cyclictest1227147-21kthreadcore20:25:561
1131020991310,2cyclictest1170554-21sh19:40:511
1131020991310,2cyclictest1165744-21kthreadcore19:35:581
1131020991310,2cyclictest0-21swapper/121:05:481
113101999136,2cyclictest1163628-21munin-run19:35:000
113101999134,5cyclictest0-21swapper/019:44:300
113101999131,7cyclictest1256075-21sort20:50:500
113101999131,5cyclictest1635-21dbus-daemon19:40:010
1131019991310,2cyclictest1700-21systemd-logind19:25:010
1131019991310,2cyclictest1268574-21latency_hist21:05:000
302487291122,3phc2sys0-21swapper/300:08:413
302487291121,2phc2sys0-21swapper/321:45:493
302487291121,2phc2sys0-21swapper/321:45:493
302487291120,3phc2sys0-21swapper/321:20:533
302487291120,3phc2sys0-21swapper/320:15:533
302487291120,2phc2sys0-21swapper/323:42:483
302487291120,2phc2sys0-21swapper/320:59:523
302487291120,2phc2sys0-21swapper/320:59:523
302487291120,2phc2sys0-21swapper/320:06:273
113102199129,1cyclictest0-21swapper/221:45:442
113102199129,1cyclictest0-21swapper/221:45:442
113102199129,1cyclictest0-21swapper/220:25:212
1131021991210,1cyclictest0-21swapper/222:40:002
113102099129,2cyclictest1336255-21aten_repower_po21:45:521
113102099129,2cyclictest1336255-21aten_repower_po21:45:521
113102099129,2cyclictest1250058-21cpuspeed_turbos20:45:511
113102099128,2cyclictest1268761-21latency_hist21:05:011
302487291111,3phc2sys0-21swapper/321:55:233
302487291110,3phc2sys0-21swapper/323:38:433
302487291110,3phc2sys0-21swapper/320:40:533
302487291110,3phc2sys0-21swapper/320:14:563
302487291110,3phc2sys0-21swapper/319:35:573
302487291110,2phc2sys0-21swapper/322:58:483
302487291110,2phc2sys0-21swapper/322:41:583
302487291110,2phc2sys0-21swapper/322:13:463
302487291110,2phc2sys0-21swapper/320:34:193
302487291110,2phc2sys0-21swapper/300:34:103
113102199119,1cyclictest0-21swapper/221:40:062
113102199119,1cyclictest0-21swapper/220:40:422
113102199119,1cyclictest0-21swapper/220:20:132
302487291101,3phc2sys0-21swapper/321:05:013
302487291101,2phc2sys0-21swapper/322:53:553
302487291101,2phc2sys0-21swapper/320:40:013
302487291101,2phc2sys0-21swapper/319:06:033
302487291101,2phc2sys0-21swapper/300:16:033
302487291100,4phc2sys0-21swapper/323:05:483
302487291100,2phc2sys0-21swapper/323:34:113
302487291100,2phc2sys0-21swapper/322:17:153
302487291100,2phc2sys0-21swapper/321:51:183
302487291100,2phc2sys0-21swapper/319:55:573
302487291100,2phc2sys0-21swapper/319:30:523
302487291100,2phc2sys0-21swapper/319:20:023
302487291100,2phc2sys0-21swapper/319:15:493
113102199107,1cyclictest0-21swapper/219:10:012
113102099103,5cyclictest1131134-21sh19:10:021
113101999104,5cyclictest1635-21dbus-daemon19:10:010
30248729192,2phc2sys0-21swapper/320:54:083
30248729191,3phc2sys0-21swapper/319:45:493
30248729191,2phc2sys0-21swapper/319:50:523
30248729190,3phc2sys0-21swapper/320:25:593
30248729190,2phc2sys0-21swapper/322:35:193
30248729190,2phc2sys0-21swapper/322:05:453
30248729190,2phc2sys0-21swapper/321:05:063
30248729190,2phc2sys0-21swapper/320:45:583
30248729190,2phc2sys0-21swapper/320:20:063
30248729190,2phc2sys0-21swapper/320:00:503
30248729190,2phc2sys0-21swapper/319:25:513
30248729190,2phc2sys0-21swapper/319:11:043
30248729180,2phc2sys0-21swapper/319:40:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional