You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 23:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Wed Dec 03, 2025 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2800521420,5sleep122917399cyclictest00:23:514
487321390,6sleep32916199cyclictest23:56:099
286242130103,22sleep100-21swapper/1019:11:442
284802122102,16sleep40-21swapper/419:09:4610
284012122106,12sleep130-21swapper/1319:08:515
287042121102,15sleep00-21swapper/019:12:060
621421130,1sleep60-21swapper/623:04:0312
1121321110,0sleep60-21swapper/600:08:1412
2119021100,4sleep32916199cyclictest22:09:429
2652821090,0sleep20-21swapper/223:13:378
28374210587,13sleep90-21swapper/919:08:3115
1456121010,2sleep341-21ksoftirqd/323:16:029
25273210072,23sleep60-21swapper/619:07:4012
87912990,1sleep10-21swapper/123:56:391
2843429975,19sleep80-21swapper/819:09:1814
256212990,0sleep70-21swapper/700:10:0813
149652990,5sleep22916099cyclictest22:08:538
73312980,0sleep30-21swapper/300:28:479
2871129779,13sleep70-21swapper/719:12:1313
124362970,1sleep70-21swapper/722:53:2213
124362970,1sleep70-21swapper/722:53:2213
245112950,0sleep130-21swapper/1323:17:165
113762950,2sleep14130-21ksoftirqd/1400:32:596
2855929483,7sleep30-21swapper/319:10:499
229822940,1sleep80-21swapper/822:02:1814
151892940,0sleep130-21swapper/1321:32:255
103132940,3sleep1110319-21sh23:37:503
211902930,8sleep92917099cyclictest23:05:5815
284352920,1sleep15138-21ksoftirqd/1500:23:547
274392920,5sleep72916699cyclictest21:22:2613
229202900,1sleep10-21swapper/123:17:041
171942900,1sleep120-21swapper/1223:53:384
81762890,6sleep32916199cyclictest00:40:339
263282890,0sleep60-21swapper/619:47:4512
2847728876,8sleep20-21swapper/219:09:448
2843928877,6sleep120-21swapper/1219:09:224
258332880,0sleep110-21swapper/1123:06:323
195182880,0sleep80-21swapper/823:12:5414
68252870,2sleep72916699cyclictest22:11:5513
239182870,2sleep130-21swapper/1300:34:345
184252870,7sleep52916499cyclictest21:17:5111
2843128672,10sleep50-21swapper/519:09:1511
172762860,1sleep100-21swapper/1021:43:042
2842028572,9sleep110-21swapper/1119:09:053
120522850,6sleep62916599cyclictest00:29:2212
85862840,0sleep110-21swapper/1119:24:343
3602840,1sleep20-21swapper/221:52:348
2846328375,4sleep150-21swapper/1519:09:417
2844528372,6sleep10-21swapper/119:09:271
49482800,1sleep10-21swapper/122:33:441
2850128072,4sleep140-21swapper/1419:09:566
68182790,1sleep40-21swapper/421:49:4010
257872790,1sleep990-21ksoftirqd/921:02:5615
194692780,0sleep50-21swapper/522:57:5311
208182760,0sleep100-21swapper/1000:14:282
165232760,0sleep40-21swapper/421:42:5810
14982750,1sleep140-21swapper/1422:52:256
14982750,1sleep140-21swapper/1422:52:256
227562700,0sleep80-21swapper/823:47:0914
253012640,29sleep40-21swapper/400:10:0510
290112580,0sleep20-21swapper/222:58:548
1139099530,3rtkit-daemon11389-21rtkit-daemon22:51:4010
1139099530,3rtkit-daemon11389-21rtkit-daemon22:51:4010
36822510,1sleep90-21swapper/920:37:4815
2915699518,36cyclictest16602-21sshd00:18:320
2916499501,35cyclictest1-21systemd23:08:2311
2916499490,3cyclictest23541-21systemd23:13:1511
2916499490,39cyclictest9769-21systemd21:46:1811
2915699491,3cyclictest1233-21gdbus22:10:480
2916899480,3cyclictest1068-21dbus-daemon23:08:4714
2916499483,43cyclictest477-21jbd2/md124p1-823:27:2411
2916499480,2cyclictest5841-21sshd00:40:1511
2916499480,2cyclictest0-21swapper/521:28:3911
2916499480,2cyclictest0-21swapper/500:31:1111
2915699480,45cyclictest29816-21sshd00:35:200
1139099480,0rtkit-daemon0-21swapper/423:14:4210
2916499472,30cyclictest135050nfsd23:31:1911
2916499470,3cyclictest1068-21dbus-daemon23:48:4311
2916499470,2cyclictest1344-21nfsd22:42:5511
2916499470,2cyclictest1344-21nfsd22:42:5511
2916499470,2cyclictest0-21swapper/522:27:1511
2915699475,40cyclictest31726-21run-parts00:39:230
2917199463,35cyclictest0-21swapper/1000:31:472
2916899463,41cyclictest525-21systemd-journal21:22:0614
2916899460,4cyclictest1068-21dbus-daemon21:14:2714
2916899460,3cyclictest9402-21gdbus22:35:0714
2916899460,3cyclictest0-21swapper/821:51:2714
2916899460,2cyclictest1073-21systemd-logind23:36:3514
2916499467,32cyclictest1-21systemd21:13:1211
29164994619,21cyclictest23004-21rm22:09:5611
2916499460,1cyclictest0-21swapper/523:54:1911
2915699460,43cyclictest7638-21systemd21:42:150
2915699460,3cyclictest1068-21dbus-daemon23:28:310
266432460,1sleep110-21swapper/1123:21:153
29171994514,27cyclictest0-21swapper/1000:24:452
2916899450,43cyclictest441-21systemd22:03:1314
2916899450,43cyclictest0-21swapper/800:00:5614
2916899450,3cyclictest5467-21gdbus22:39:0714
2916899450,3cyclictest5467-21gdbus22:39:0714
2916899450,38cyclictest0-21swapper/800:18:2114
2916499451,32cyclictest1068-21dbus-daemon23:46:5511
2916499450,6cyclictest4551-21sshd22:37:3511
2916499450,6cyclictest4551-21sshd22:37:3511
2916499450,43cyclictest1350-21nfsd21:22:4811
2916499450,2cyclictest1347-21nfsd23:02:3911
2916499450,2cyclictest0-21swapper/523:58:2311
2916499450,2cyclictest0-21swapper/523:19:5511
2916499450,2cyclictest0-21swapper/522:05:5911
2916499450,2cyclictest0-21swapper/520:57:3511
2916499450,2cyclictest0-21swapper/520:02:4711
2916499450,2cyclictest0-21swapper/520:02:4711
2916499450,1cyclictest0-21swapper/523:39:1111
2916499450,1cyclictest0-21swapper/523:32:5111
2916499450,1cyclictest0-21swapper/522:35:4311
2916499450,1cyclictest0-21swapper/522:27:4311
2916499450,1cyclictest0-21swapper/522:14:3111
2916499450,1cyclictest0-21swapper/521:55:2711
2916499450,1cyclictest0-21swapper/520:07:5111
2916499450,1cyclictest0-21swapper/520:07:5111
2915699451,41cyclictest4372-2110-uname21:56:370
2915699450,43cyclictest28531-21sshd23:55:020
199822450,1sleep130-21swapper/1319:37:595
29173994416,13cyclictest0-21swapper/1222:42:374
29173994416,13cyclictest0-21swapper/1222:42:374
2916899440,4cyclictest22342-21systemd21:40:1114
2916499441,41cyclictest1349-21nfsd22:18:0411
2916499441,32cyclictest1072-21ModemManager00:08:5911
2916499440,3cyclictest1351-21nfsd21:51:4311
2916499440,2cyclictest0-21swapper/522:52:5111
2916499440,2cyclictest0-21swapper/522:52:5111
2916499440,2cyclictest0-21swapper/521:41:5611
2916499440,2cyclictest0-21swapper/500:24:2711
2916499440,2cyclictest0-21swapper/500:20:5511
2916499440,2cyclictest0-21swapper/500:14:2311
2916499440,1cyclictest0-21swapper/522:49:1911
2916499440,1cyclictest0-21swapper/522:49:1911
2916499440,1cyclictest0-21swapper/522:00:1111
2916499440,1cyclictest0-21swapper/500:37:1511
2915699449,32cyclictest145-21kauditd22:54:160
2915699449,32cyclictest145-21kauditd22:54:160
2915699441,40cyclictest29814-21bash23:47:470
2915699441,40cyclictest1282-21snmpd23:14:370
2915699440,42cyclictest13571-21sshd21:50:240
2915699440,41cyclictest6817-21sshd23:45:130
1139099440,1rtkit-daemon0-21swapper/1223:20:174
2917199439,27cyclictest0-21swapper/1023:26:262
2916899432,38cyclictest1-21systemd22:29:5514
2916899430,3cyclictest12477-21sshd23:04:5114
2916899430,3cyclictest1-21systemd22:22:1514
2916899430,2cyclictest0-21swapper/821:46:0314
2916499430,4cyclictest1068-21dbus-daemon00:02:3511
2916499430,36cyclictest209321sh21:36:3311
2916499430,2cyclictest0-21swapper/519:38:5111
2916499430,1cyclictest0-21swapper/520:43:4311
2916499430,1cyclictest0-21swapper/519:50:1911
2916499430,1cyclictest0-21swapper/519:27:5911
2915699439,32cyclictest1297-21sshd22:04:190
2915699437,33cyclictest561-2110-uname00:11:420
2915699431,3cyclictest1-21systemd22:15:250
2915699431,39cyclictest16618-21sshd22:42:460
2915699431,39cyclictest16618-21sshd22:42:460
2915699431,39cyclictest1-21systemd21:43:190
2915699430,40cyclictest14608-21systemd00:01:150
2915699430,3cyclictest19524-21cat21:32:470
2915699430,3cyclictest1-21systemd21:18:190
29171994215,25cyclictest0-21swapper/1021:49:342
29171994215,25cyclictest0-21swapper/1021:23:142
29171994214,25cyclictest22672-21systemd00:09:372
29171994214,18cyclictest10731systemd-logind22:53:272
29171994214,18cyclictest10731systemd-logind22:53:272
29171994212,27cyclictest1068-21dbus-daemon21:59:022
29171994212,27cyclictest0-21swapper/1022:30:222
2916899427,33cyclictest401-2110-uname00:16:5414
2916899427,33cyclictest1-21systemd22:24:1814
2916899425,7cyclictest0-21swapper/822:54:3014
2916899425,7cyclictest0-21swapper/822:54:3014
2916899421,3cyclictest1068-21dbus-daemon21:54:0114
2916899420,40cyclictest9865-21sshd23:37:4814
2916899420,40cyclictest0-21swapper/823:25:0014
2916899420,3cyclictest1068-21dbus-daemon21:31:1514
2916499420,2cyclictest0-21swapper/519:58:1111
2915699429,31cyclictest14687-21sshd22:19:440
2915699423,3cyclictest1068-21dbus-daemon22:48:170
2915699423,3cyclictest1068-21dbus-daemon22:48:170
29156994210,30cyclictest1281-21systemd23:11:030
2915699420,4cyclictest32381-21systemd23:25:510
2915699420,39cyclictest5472-21sshd00:03:550
2915699420,37cyclictest11561-21sshd22:38:070
2915699420,37cyclictest11561-21sshd22:38:070
1139099420,25rtkit-daemon1-21systemd21:47:074
1139099420,1rtkit-daemon11389-21rtkit-daemon22:37:464
1139099420,1rtkit-daemon11389-21rtkit-daemon22:37:464
2917199418,22cyclictest1068-21dbus-daemon21:33:072
29171994113,25cyclictest5454-21systemd21:56:442
29171994113,17cyclictest240341sshd21:22:032
29171994111,27cyclictest3888-21sshd00:03:412
29171994111,27cyclictest1245-21gdbus23:13:092
2916899419,30cyclictest25657-21sshd00:23:3614
2916899418,31cyclictest30632-2110-uname22:44:1714
2916899418,31cyclictest30632-2110-uname22:44:1714
2916899418,31cyclictest21143-21systemd00:30:3214
2916899418,30cyclictest32247-2110-uname00:35:3814
2916899410,4cyclictest15658-21kill22:12:4714
2916899410,3cyclictest1072-21ModemManager21:24:2714
2916899410,3cyclictest1068-21dbus-daemon22:09:5514
2916899410,38cyclictest29818-21sshd00:02:5514
2916499410,1cyclictest0-21swapper/521:07:4711
2916499410,1cyclictest0-21swapper/521:02:5111
2916499410,1cyclictest0-21swapper/520:12:3511
2916499410,1cyclictest0-21swapper/520:12:3511
2916499410,1cyclictest0-21swapper/519:36:0311
2915699418,31cyclictest525-21systemd-journal23:02:360
2915699418,30cyclictest29440-21run-parts00:27:480
2915699418,30cyclictest25466-21sshd21:25:460
2915699417,6cyclictest1349-21nfsd22:25:420
2915699417,32cyclictest1351-21nfsd21:30:270
2915699417,32cyclictest11013-21rm21:17:120
2915699410,4cyclictest2962-21kill22:29:550
2915699410,4cyclictest28321-21sshd23:39:580
2917199409,24cyclictest0-21swapper/1022:10:262
29171994023,14cyclictest0-21swapper/1023:08:072
2917199402,26cyclictest0-21swapper/1022:42:522
2917199402,26cyclictest0-21swapper/1022:42:522
29171994014,23cyclictest0-21swapper/1023:40:272
29171994011,15cyclictest2659-21gdbus23:35:332
2916899408,30cyclictest0-21swapper/800:40:0914
2916899402,36cyclictest389-21md124_raid122:59:0814
29168994011,27cyclictest32398-21sshd00:11:3514
2916899400,4cyclictest525-21systemd-journal23:18:5514
2916899400,38cyclictest6409-21sshd23:48:4114
2916899400,38cyclictest0-21swapper/821:33:3614
2916499400,2cyclictest0-21swapper/519:52:5511
2916499400,1cyclictest0-21swapper/520:48:3111
2916499400,1cyclictest0-21swapper/520:33:1911
2916499400,1cyclictest0-21swapper/520:22:3511
2916499400,1cyclictest0-21swapper/520:17:3911
2916499400,1cyclictest0-21swapper/520:17:3911
2916499400,1cyclictest0-21swapper/519:18:0311
2916499400,1cyclictest0-21swapper/519:14:0311
2915699409,28cyclictest3042-21systemd23:33:180
2915699408,30cyclictest23459-21run-parts22:58:130
2915699401,3cyclictest14741-21sshd00:13:210
2915699401,2cyclictest0-21swapper/000:22:560
2915699400,38cyclictest3966-21systemd21:59:580
2915699400,37cyclictest13635-21sshd23:19:330
264172400,6sleep102917199cyclictest23:02:472
1139099400,10rtkit-daemon0-21swapper/400:20:5510
2917199398,28cyclictest0-21swapper/1023:54:242
2917199397,26cyclictest0-21swapper/1000:39:262
29171993930,7cyclictest14382-21sshd00:37:322
29171993923,13cyclictest1069-21NetworkManager22:05:462
29171993918,18cyclictest1068-21dbus-daemon23:29:572
29171993915,17cyclictest100761run-parts21:17:062
29171993910,23cyclictest31192-21latency23:47:532
2916899396,31cyclictest95850irq/36-eth0-TxR23:55:3414
2916899393,3cyclictest1233-21gdbus23:29:3314
2916899391,3cyclictest28411-21sshd22:47:5414
2916899391,3cyclictest28411-21sshd22:47:5414
2916499393,34cyclictest15636-21expr20:52:4811
2916499390,1cyclictest0-21swapper/520:38:0311
2916499390,1cyclictest0-21swapper/520:28:1511
2915699395,4cyclictest9402-21gdbus22:37:010
2917199387,29cyclictest0-21swapper/1000:20:322
29171993817,18cyclictest3939-21cp22:22:302
29171993817,18cyclictest1189-21sshd21:41:292
29171993813,18cyclictest0-21swapper/1023:46:462
29171993812,16cyclictest1068-21dbus-daemon22:48:422
29171993812,16cyclictest1068-21dbus-daemon22:48:422
29171993811,22cyclictest0-21swapper/1020:08:392
29171993811,22cyclictest0-21swapper/1020:08:392
29171993810,26cyclictest0-21swapper/1022:17:252
29171993810,22cyclictest525-21systemd-journal23:58:122
2916899387,27cyclictest21832-21/usr/sbin/munin19:42:4914
2916899380,3cyclictest25927-21/usr/sbin/munin19:47:5514
2916499380,2cyclictest0-21swapper/519:46:3911
2916499380,1cyclictest0-21swapper/519:23:0311
1139099380,2rtkit-daemon9992-21systemd00:40:474
29171993725,9cyclictest22718-21ffmpeg21:02:342
29171993719,16cyclictest0-21swapper/1023:21:352
29171993717,17cyclictest0-21swapper/1021:29:412
29171993716,18cyclictest0-21swapper/1020:57:472
29171993715,19cyclictest0-21swapper/1022:35:302
29171993713,18cyclictest21719-21sshd23:02:162
29171993711,18cyclictest1245-21gdbus22:38:422
29171993711,18cyclictest1245-21gdbus22:38:422
29170993722,6cyclictest38950md124_raid100:20:1615
2915699371,4cyclictest17364-21ls20:13:040
2915699371,4cyclictest17364-21ls20:13:040
1139099370,0rtkit-daemon0-21swapper/421:13:3610
1139099370,0rtkit-daemon0-21swapper/1223:35:584
29171993619,15cyclictest0-21swapper/1019:48:002
29171993618,16cyclictest0-21swapper/1019:13:552
29171993616,18cyclictest0-21swapper/1019:42:502
29171993615,18cyclictest0-21swapper/1020:38:042
29171993613,20cyclictest5615-21sshd22:22:392
2917199361,30cyclictest0-21swapper/1020:33:262
2916899360,4cyclictest28944-21grep20:27:5614
2915699361,2cyclictest0-21swapper/020:27:540
2915699361,2cyclictest0-21swapper/019:52:580
190532360,1sleep30-21swapper/321:47:309
29171993518,15cyclictest0-21swapper/1020:47:252
29171993516,17cyclictest0-21swapper/1020:12:452
29171993516,17cyclictest0-21swapper/1020:12:452
29171993515,18cyclictest0-21swapper/1020:48:432
29171993515,18cyclictest0-21swapper/1020:02:352
29171993515,18cyclictest0-21swapper/1020:02:352
29171993515,18cyclictest0-21swapper/1019:21:072
2916899350,2cyclictest0-21swapper/820:57:5414
2915699351,3cyclictest0-21swapper/019:47:480
2915699350,3cyclictest22265-21cpuspeed_turbos19:42:470
2915699350,3cyclictest12669-21awk20:07:550
2915699350,3cyclictest12669-21awk20:07:550
10758-21350,9systemd2917799cyclictest00:29:117
2917199343,29cyclictest0-21swapper/1019:52:472
29171993418,14cyclictest0-21swapper/1019:27:532
29171993418,13cyclictest25409-21switchtime20:23:032
29171993415,18cyclictest0-21swapper/1020:27:342
29171993415,17cyclictest0-21swapper/1021:08:062
29171993415,17cyclictest0-21swapper/1020:20:372
29171993415,17cyclictest0-21swapper/1020:20:372
29171993414,17cyclictest16540-21ls19:33:032
29171993414,17cyclictest0-21swapper/1019:37:532
29171993412,19cyclictest0-21swapper/1019:22:552
29170993431,2cyclictest881rcuc/921:22:0115
2917099340,32cyclictest5467-21gdbus22:10:4815
2917099340,27cyclictest0-21swapper/923:28:5115
2916899345,2cyclictest5290-21switchtime20:38:0414
2916899344,3cyclictest1349-21nfsd20:49:1014
2916899340,4cyclictest17365-21sort20:13:0414
2916899340,4cyclictest17365-21sort20:13:0414
2915699341,4cyclictest12193-21timerandwakeup19:28:030
2915699341,3cyclictest31242-21cut21:12:330
2915699341,3cyclictest0-21swapper/020:07:330
2915699341,3cyclictest0-21swapper/020:07:330
2915699341,2cyclictest0-21swapper/019:37:470
2915699340,3cyclictest0-21swapper/020:57:550
29171993315,17cyclictest0-21swapper/1019:57:332
29171993314,17cyclictest0-21swapper/1020:52:342
2917099334,27cyclictest10477-21sshd21:35:2315
2917099333,22cyclictest5467-21gdbus23:13:2315
2917099331,29cyclictest1068-21dbus-daemon22:06:0615
2916899330,7cyclictest0-21swapper/821:12:1914
2915699333,3cyclictest3607-21expr20:37:480
2915699331,3cyclictest29993-21grep19:12:470
325732320,1sleep40-21swapper/423:44:2510
2917099324,25cyclictest159361sshd22:42:4215
2917099324,25cyclictest159361sshd22:42:4215
2917099321,22cyclictest5467-21gdbus22:59:3315
2917099320,22cyclictest0-21swapper/922:27:4715
2916899321,3cyclictest1238-21gdbus20:02:3214
2916899320,3cyclictest1768-21tr19:17:4714
2916899320,3cyclictest0-21swapper/820:32:4914
2915699321,4cyclictest1767-21grep19:17:470
2915699321,3cyclictest31248-21cpuspeed_turbos20:32:460
2915699321,3cyclictest0-21swapper/020:22:500
2915699320,3cyclictest16671-21chrt20:52:540
2915699320,3cyclictest15550-21nfsd419:32:540
271252320,2sleep30-21swapper/322:36:279
173602320,1sleep40-21swapper/400:13:4910
171952320,1sleep20-21swapper/200:13:488
1139099320,1rtkit-daemon17373-21systemd23:46:304
73312310,27sleep60-21swapper/621:35:0012
2917099314,25cyclictest1297-21sshd23:21:4915
2917099313,22cyclictest0-21swapper/923:59:4315
2917099313,20cyclictest28228-21sshd23:51:2315
2917099313,20cyclictest1-21systemd00:24:5315
2917099312,22cyclictest0-21swapper/923:35:4815
2917099312,22cyclictest0-21swapper/921:26:4115
29170993115,5cyclictest540-21sshd22:48:2115
29170993115,5cyclictest540-21sshd22:48:2115
29170993115,14cyclictest0-21swapper/922:35:1715
2916899313,3cyclictest13354-21timerwakeupswit20:08:0314
2916899313,3cyclictest13354-21timerwakeupswit20:08:0314
2916899310,4cyclictest30933-21df19:52:4914
2916899310,3cyclictest13055-21cat19:32:3314
2915699310,4cyclictest2977-21fschecks_time19:57:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional