You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 20:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Sun Nov 30, 2025 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332621530,5sleep5468399cyclictest00:08:3811
1237921360,0sleep30-21swapper/300:16:059
39892128104,19sleep90-21swapper/919:09:5915
39412120104,9sleep50-21swapper/519:09:2311
1307021190,17sleep1496350irq/41-eth0-TxR22:08:416
4075211792,21sleep130-21swapper/1319:11:075
251421170,1sleep120-21swapper/1223:19:324
2366821170,5sleep5468399cyclictest00:32:4211
807921130,1sleep50-21swapper/523:12:4411
2860321110,16sleep15469799cyclictest23:15:027
1093421110,0sleep30-21swapper/300:02:269
489621080,1sleep100-21swapper/1022:00:042
3918210892,12sleep120-21swapper/1219:09:144
1701921080,1sleep140-21swapper/1421:35:316
4072210792,10sleep100-21swapper/1019:11:042
686221050,1sleep50-21swapper/522:03:5911
3942210490,10sleep60-21swapper/619:09:2412
1560621030,2sleep131201rcuc/1322:58:095
1560621030,2sleep131201rcuc/1322:58:095
1363821020,1sleep813635-21systemd-cgroups00:23:3914
3937210181,16sleep20-21swapper/219:09:208
166372990,6sleep6468499cyclictest22:58:1812
166372990,6sleep6468499cyclictest22:58:1812
196452980,0sleep90-21swapper/923:32:5115
77982970,1sleep70-21swapper/722:27:0113
315929485,4sleep00-21swapper/019:07:580
151932930,1sleep100-21swapper/1023:21:062
46292910,1sleep50-21swapper/523:08:2711
46292910,1sleep50-21swapper/523:08:2711
286742910,0sleep50-21swapper/500:13:2611
27772910,6sleep8468899cyclictest00:37:5014
1139099910,82rtkit-daemon0-21swapper/1519:07:377
112022910,1sleep4471rcuc/421:16:2210
421029075,11sleep30-21swapper/319:12:189
394329076,10sleep70-21swapper/719:09:2513
63828972,11sleep140-21swapper/1419:07:406
400028981,4sleep110-21swapper/1119:10:013
234862880,0sleep20-21swapper/221:54:518
64328772,10sleep10-21swapper/119:07:431
412128572,7sleep40-21swapper/419:11:4710
292942850,1sleep1329293-21sh22:37:015
204882850,0sleep150-21swapper/1522:39:447
197552850,1sleep15138-21ksoftirqd/1521:13:367
68812840,1sleep70-21swapper/722:37:5913
238602840,0sleep30-21swapper/323:03:049
238602840,0sleep30-21swapper/323:03:049
167342830,6sleep9468999cyclictest00:11:3815
223952820,0sleep140-21swapper/1422:20:596
139942820,1sleep120-21swapper/1200:06:204
389128072,4sleep80-21swapper/819:08:5414
304502780,0sleep30-21swapper/319:42:469
150382780,0sleep140-21swapper/1421:16:486
284422750,0sleep80-21swapper/821:18:0214
23392750,0sleep90-21swapper/920:27:3115
23392750,0sleep90-21swapper/920:27:3115
120962700,40sleep695950irq/37-eth0-TxR23:13:0112
469199550,47cyclictest0-21swapper/1123:01:133
469199550,47cyclictest0-21swapper/1123:01:133
469199531,49cyclictest4721-2110-uname21:19:033
469799525,45cyclictest7426-21run-parts21:34:217
469199521,43cyclictest4557-21gdbus00:22:193
469199521,39cyclictest27644-21systemd23:37:413
469199500,44cyclictest0-21swapper/1123:11:373
469199500,44cyclictest0-21swapper/1123:11:373
469199500,41cyclictest0-21swapper/1122:38:593
469199500,41cyclictest0-21swapper/1121:26:043
469199500,39cyclictest0-21swapper/1122:13:243
469199500,39cyclictest0-21swapper/1100:00:073
469199491,41cyclictest0-21swapper/1122:10:493
469199491,41cyclictest0-21swapper/1121:16:283
469199490,47cyclictest0-21swapper/1121:37:503
469199490,44cyclictest0-21swapper/1100:02:403
469199490,42cyclictest11928-21sshd23:54:363
469199490,41cyclictest0-21swapper/1123:04:063
469199490,41cyclictest0-21swapper/1123:04:063
468599490,2cyclictest1-21systemd23:31:3313
468599490,2cyclictest0-21swapper/723:47:5413
121972490,1sleep150-21swapper/1522:34:557
1139099490,4rtkit-daemon2748-21ngircd23:35:444
1139099490,1rtkit-daemon0-21swapper/423:04:344
1139099490,1rtkit-daemon0-21swapper/423:04:344
469799481,45cyclictest7197-21sshd22:15:327
469799480,3cyclictest1073-21systemd-logind23:07:217
469799480,3cyclictest1073-21systemd-logind23:07:217
469799480,3cyclictest0-21swapper/1523:47:337
469799480,2cyclictest4364-21sshd23:31:217
469199481,44cyclictest0-21swapper/1123:50:443
469199481,39cyclictest0-21swapper/1122:21:123
469199480,41cyclictest8426-21sshd23:42:583
469199480,41cyclictest0-21swapper/1123:12:413
469199480,40cyclictest0-21swapper/1122:42:553
468599480,46cyclictest30674-21uname21:40:3813
468599480,2cyclictest0-21swapper/722:29:4513
1139099480,2rtkit-daemon11389-21rtkit-daemon22:31:0910
469799470,2cyclictest0-21swapper/1522:29:457
469199471,42cyclictest14251-2110-uname00:16:213
469199471,38cyclictest1072-21ModemManager00:26:193
469199471,38cyclictest1068-21dbus-daemon00:38:283
469199470,40cyclictest14698-21kill21:57:383
469199470,39cyclictest6530-21systemd-cgroups22:26:513
469199470,39cyclictest0-21swapper/1121:33:473
468599470,3cyclictest1068-21dbus-daemon21:55:2513
468599470,2cyclictest0-21swapper/723:15:3713
468599470,2cyclictest0-21swapper/723:04:4113
468599470,2cyclictest0-21swapper/723:04:4113
468599470,2cyclictest0-21swapper/722:36:3713
468599470,2cyclictest0-21swapper/721:27:3313
468599470,1cyclictest0-21swapper/723:24:4513
468599470,1cyclictest0-21swapper/721:45:2513
1139099470,22rtkit-daemon0-21swapper/1223:52:484
1139099470,0rtkit-daemon0-21swapper/400:01:294
469799461,3cyclictest1068-21dbus-daemon22:54:537
469799461,3cyclictest1068-21dbus-daemon22:54:537
469799461,3cyclictest0-21swapper/1521:18:577
469799460,4cyclictest1-21systemd21:38:177
469799460,3cyclictest30417-21sshd00:13:577
469799460,3cyclictest1-21systemd23:08:337
469799460,3cyclictest1-21systemd23:08:337
469799460,3cyclictest1073-21systemd-logind22:12:137
469799460,3cyclictest0-21swapper/1522:57:537
469799460,3cyclictest0-21swapper/1522:57:537
469799460,3cyclictest0-21swapper/1522:03:257
469799460,2cyclictest0-21swapper/1522:19:337
469799460,2cyclictest0-21swapper/1500:09:217
469199461,42cyclictest16072-21sed22:27:503
469199461,39cyclictest1068-21dbus-daemon23:34:333
469199460,37cyclictest30208-21sshd22:48:343
469199460,37cyclictest1351-21nfsd00:37:043
469199460,36cyclictest0-21swapper/1122:03:363
468599463,40cyclictest0-21swapper/722:16:2713
468599460,3cyclictest28275-21sshd00:40:5713
468599460,2cyclictest0-21swapper/722:21:0913
468599460,2cyclictest0-21swapper/721:48:2113
468599460,2cyclictest0-21swapper/700:16:3313
468599460,1cyclictest0-21swapper/722:05:0113
468599460,1cyclictest0-21swapper/721:17:0113
469799455,37cyclictest21804-21nfsd423:17:537
469799451,42cyclictest1-21systemd23:58:187
469799450,3cyclictest5467-21gdbus23:45:257
469799450,3cyclictest3724-21kworker/15:022:51:097
469799450,3cyclictest24719-21sshd00:21:237
469799450,3cyclictest1068-21dbus-daemon22:25:257
469799450,3cyclictest0-21swapper/1521:59:217
469799450,2cyclictest0-21swapper/1523:40:537
469799450,2cyclictest0-21swapper/1521:50:377
469799450,2cyclictest0-21swapper/1521:42:377
469799450,2cyclictest0-21swapper/1500:05:057
469199450,43cyclictest0-21swapper/1122:53:393
469199450,43cyclictest0-21swapper/1122:53:393
469199450,42cyclictest0-21swapper/1100:31:223
469199450,38cyclictest0-21swapper/1123:23:333
469199450,38cyclictest0-21swapper/1122:34:233
469199450,37cyclictest0-21swapper/1123:28:243
469199450,37cyclictest0-21swapper/1121:54:303
469199450,37cyclictest0-21swapper/1100:10:033
469199450,34cyclictest0-21swapper/1123:21:313
468599452,40cyclictest1-21systemd21:18:1113
468599450,2cyclictest0-21swapper/723:46:4513
468599450,2cyclictest0-21swapper/723:34:3313
468599450,2cyclictest0-21swapper/723:19:3313
468599450,2cyclictest0-21swapper/723:11:2513
468599450,2cyclictest0-21swapper/723:11:2513
468599450,2cyclictest0-21swapper/723:02:2113
468599450,2cyclictest0-21swapper/723:02:2113
468599450,2cyclictest0-21swapper/722:54:5313
468599450,2cyclictest0-21swapper/722:54:5313
468599450,2cyclictest0-21swapper/700:32:1313
468599450,2cyclictest0-21swapper/700:02:5313
468599450,2cyclictest0-21swapper/700:01:5513
468599450,1cyclictest0-21swapper/723:53:4113
468599450,1cyclictest0-21swapper/721:35:0513
468599450,1cyclictest0-21swapper/721:22:4913
1139099450,0rtkit-daemon0-21swapper/400:27:574
469799440,3cyclictest525-21systemd-journal00:27:457
469799440,3cyclictest24373-21systemd-cgroups21:28:457
469799440,3cyclictest1068-21dbus-daemon21:56:017
469799440,2cyclictest0-21swapper/1523:52:457
469799440,2cyclictest0-21swapper/1523:37:177
469799440,2cyclictest0-21swapper/1521:23:297
469799440,2cyclictest0-21swapper/1500:41:537
469199440,38cyclictest19457-21kill21:50:543
468599442,39cyclictest1-21systemd21:58:3513
468599441,40cyclictest1245-21gdbus22:07:5613
468599440,42cyclictest22477-21sshd22:43:4913
468599440,41cyclictest17143-21sshd00:20:2413
468599440,3cyclictest525-21systemd-journal00:23:0913
468599440,2cyclictest675-21kworker/7:220:37:3313
468599440,2cyclictest675-21kworker/7:220:37:3313
468599440,2cyclictest0-21swapper/722:47:4513
468599440,2cyclictest0-21swapper/720:09:0513
468599440,2cyclictest0-21swapper/700:07:5713
468599440,1cyclictest0-21swapper/720:12:5713
468599440,1cyclictest0-21swapper/719:28:2913
1139099440,2rtkit-daemon12578-21sshd21:46:154
1139099440,1rtkit-daemon0-21swapper/420:22:474
1139099440,1rtkit-daemon0-21swapper/420:22:474
469799430,3cyclictest0-21swapper/1522:43:057
469799430,3cyclictest0-21swapper/1519:12:457
469799430,3cyclictest0-21swapper/1500:34:037
469799430,2cyclictest0-21swapper/1523:24:297
469799430,2cyclictest0-21swapper/1500:26:057
469199432,34cyclictest134750nfsd19:24:243
469199430,40cyclictest525-21systemd-journal21:43:133
469199430,36cyclictest0-21swapper/1121:29:403
468599430,2cyclictest0-21swapper/721:03:0513
468599430,2cyclictest0-21swapper/700:32:5313
468599430,1cyclictest0-21swapper/720:19:5313
468599430,1cyclictest0-21swapper/720:19:5313
158442430,6sleep990-21ksoftirqd/900:06:3315
1139099430,18rtkit-daemon0-21swapper/519:31:2011
469799420,3cyclictest1351-21nfsd20:24:057
469799420,3cyclictest1351-21nfsd20:24:057
469799420,2cyclictest0-21swapper/1519:23:497
469199420,39cyclictest27605-21grep20:17:473
469199420,39cyclictest27605-21grep20:17:473
469199420,39cyclictest23203-21expr20:12:473
468599420,2cyclictest0-21swapper/720:44:5713
468599420,2cyclictest0-21swapper/720:28:0513
468599420,2cyclictest0-21swapper/720:28:0513
468599420,2cyclictest0-21swapper/719:39:0113
468599420,2cyclictest0-21swapper/719:22:5313
468599420,1cyclictest0-21swapper/723:38:3713
468599420,1cyclictest0-21swapper/720:49:0913
468599420,1cyclictest0-21swapper/720:32:4913
468599420,1cyclictest0-21swapper/720:32:4913
468599420,1cyclictest0-21swapper/719:53:1713
468599420,1cyclictest0-21swapper/719:47:4513
468599420,1cyclictest0-21swapper/719:42:5313
468599420,1cyclictest0-21swapper/719:32:5713
468599420,1cyclictest0-21swapper/719:13:3313
1139099420,27rtkit-daemon2748-21ngircd19:13:3311
469799410,2cyclictest0-21swapper/1519:47:447
469199410,38cyclictest32430-21df_abs21:02:473
469199410,38cyclictest0-21swapper/1121:00:023
468599410,2cyclictest1350-21nfsd21:07:5313
468599410,2cyclictest0-21swapper/720:58:3713
468599410,1cyclictest0-21swapper/719:58:2113
469799403,34cyclictest1580-21switchtime21:03:027
469799400,2cyclictest0-21swapper/1520:43:177
469799400,2cyclictest0-21swapper/1520:37:497
469799400,2cyclictest0-21swapper/1520:37:497
469199401,36cyclictest0-21swapper/1120:32:533
469199401,36cyclictest0-21swapper/1120:32:533
469199400,38cyclictest0-21swapper/1120:02:563
469199400,37cyclictest9921-21/usr/sbin/munin19:57:533
469199400,37cyclictest18925-21/usr/sbin/munin20:47:563
469199400,37cyclictest13403-21cat20:38:013
469199400,37cyclictest13403-21cat20:38:013
468599400,2cyclictest0-21swapper/719:18:1313
1139099400,0rtkit-daemon0-21swapper/1221:32:354
469799391,36cyclictest24918-21needreboot20:52:527
469799390,3cyclictest0-21swapper/1520:32:537
469799390,3cyclictest0-21swapper/1520:32:537
469799390,2cyclictest0-21swapper/1519:52:337
469799390,2cyclictest0-21swapper/1519:40:537
469199391,35cyclictest9571-21cut19:17:463
469199391,35cyclictest0-21swapper/1119:42:463
469199390,37cyclictest0-21swapper/1121:08:133
469199390,37cyclictest0-21swapper/1120:23:533
469199390,37cyclictest0-21swapper/1120:23:533
469199390,36cyclictest22584-21cut19:32:483
469199390,36cyclictest19548-21grep20:07:483
469199390,36cyclictest0-21swapper/1119:52:443
469199390,35cyclictest0-21swapper/1120:27:553
469199390,35cyclictest0-21swapper/1120:27:553
469199390,32cyclictest0-21swapper/1120:52:533
468599390,2cyclictest0-21swapper/720:52:4613
468599390,1cyclictest0-21swapper/720:23:0913
468599390,1cyclictest0-21swapper/720:23:0913
469799383,30cyclictest4777-21cat21:07:537
469799382,34cyclictest19913-21df_abs20:47:467
469799380,2cyclictest0-21swapper/1519:58:077
469799380,1cyclictest0-21swapper/1520:57:457
469199381,35cyclictest25749-21expr19:37:453
469199380,36cyclictest0-21swapper/1120:42:493
469199380,36cyclictest0-21swapper/1119:27:573
469199380,36cyclictest0-21swapper/1119:14:093
469199380,33cyclictest0-21swapper/1119:49:223
468599380,2cyclictest0-21swapper/720:02:3713
469799374,31cyclictest19663-21http_loadtime20:07:507
469799370,2cyclictest0-21swapper/1520:29:017
469799370,2cyclictest0-21swapper/1520:29:017
469799370,2cyclictest0-21swapper/1520:02:537
303312370,5sleep233-21ksoftirqd/200:13:568
469799363,30cyclictest9321-21cat19:17:467
469799361,33cyclictest1349-21nfsd19:33:257
1139099360,0rtkit-daemon0-21swapper/420:59:044
76362350,0sleep130-21swapper/1300:34:265
469799350,3cyclictest19637-21mailstats19:27:557
469799350,3cyclictest0-21swapper/1520:17:537
469799350,3cyclictest0-21swapper/1520:17:537
469799350,2cyclictest0-21swapper/1520:13:237
468899355,27cyclictest6741-21bash23:42:5114
4688993517,16cyclictest0-21swapper/823:50:4414
468299350,32cyclictest0-21swapper/423:26:1910
266572350,31sleep326802-21bash22:55:529
266572350,31sleep326802-21bash22:55:529
1139099350,0rtkit-daemon0-21swapper/1222:16:234
469799347,25cyclictest30796-21fschecks_time19:42:487
468299341,27cyclictest0-21swapper/400:36:2710
468299340,32cyclictest0-21swapper/421:55:0410
116212340,30sleep90-21swapper/922:31:2115
1139099340,0rtkit-daemon0-21swapper/1223:23:194
468299335,25cyclictest0-21swapper/421:46:0710
468299330,26cyclictest9622-21sshd22:19:2210
467899333,23cyclictest0-21swapper/123:54:301
467799336,24cyclictest255791sshd00:17:430
467799333,27cyclictest525-21systemd-journal22:38:560
467799333,27cyclictest0-21swapper/023:42:510
467799330,31cyclictest0-21swapper/021:32:090
326652330,1sleep50-21swapper/523:00:2511
326652330,1sleep50-21swapper/523:00:2511
165982330,6sleep1467899cyclictest00:20:201
468899322,24cyclictest1-21systemd00:19:4414
468299324,25cyclictest1073-21systemd-logind23:11:2010
468299324,25cyclictest1073-21systemd-logind23:11:2010
468299324,18cyclictest0-21swapper/423:40:0310
4682993216,15cyclictest0-21swapper/400:15:5510
467899320,30cyclictest0-21swapper/121:37:501
467799324,26cyclictest0-21swapper/022:01:250
467799324,25cyclictest0-21swapper/000:13:500
467799323,28cyclictest0-21swapper/022:50:480
467799322,24cyclictest0-21swapper/021:37:580
467799321,25cyclictest4478-21sshd22:03:410
467799320,25cyclictest0-21swapper/000:03:230
151582320,28sleep30-21swapper/323:47:459
1139099320,0rtkit-daemon0-21swapper/1221:47:584
468899312,23cyclictest214311sshd23:29:2614
468899312,23cyclictest0-21swapper/822:19:1714
4688993114,14cyclictest1567-21sshd21:26:0814
4688993112,17cyclictest0-21swapper/800:00:3814
468299319,20cyclictest0-21swapper/422:07:5610
468299318,21cyclictest9807-21env23:58:0410
468299313,22cyclictest5464-21packagekitd22:35:2610
468299312,12cyclictest0-21swapper/421:58:0410
468299311,24cyclictest0-21swapper/422:55:4810
468299311,24cyclictest0-21swapper/422:55:4810
468299311,23cyclictest1073-21systemd-logind22:46:1110
4678993127,2cyclictest231rcuc/100:42:181
467799312,22cyclictest0-21swapper/021:22:080
4677993116,13cyclictest0-21swapper/000:37:370
467799311,28cyclictest30575-21systemd-cgroups23:03:570
467799311,28cyclictest30575-21systemd-cgroups23:03:570
467799311,24cyclictest0-21swapper/022:33:300
467799310,29cyclictest0-21swapper/022:57:470
467799310,29cyclictest0-21swapper/022:57:470
207552310,3sleep51073-21systemd-logind22:17:0711
156962310,1sleep140-21swapper/1422:58:116
156962310,1sleep140-21swapper/1422:58:116
89792300,2sleep60-21swapper/621:38:0512
468899305,12cyclictest16760-21kill22:35:2614
4688993012,16cyclictest0-21swapper/821:15:2514
468899300,28cyclictest1-21systemd23:18:4014
468299307,17cyclictest68521systemd21:26:5010
467899301,27cyclictest0-21swapper/100:14:421
467799306,22cyclictest27049-21systemd21:14:250
467799305,22cyclictest0-21swapper/022:27:000
467799305,17cyclictest0-21swapper/023:24:550
467799304,24cyclictest0-21swapper/021:52:560
467799304,14cyclictest253931run-parts22:55:420
467799304,14cyclictest253931run-parts22:55:420
467799303,25cyclictest0-21swapper/000:24:370
467799303,22cyclictest0-21swapper/023:11:310
467799303,22cyclictest0-21swapper/023:11:310
467799303,14cyclictest0-21swapper/023:48:070
467799302,26cyclictest0-21swapper/022:32:110
467799302,22cyclictest0-21swapper/022:17:350
467799302,22cyclictest0-21swapper/000:11:050
467799301,27cyclictest1245-21gdbus23:28:490
467799301,23cyclictest5251systemd-journal23:15:300
4677993011,17cyclictest0-21swapper/023:33:580
220692300,1sleep140-21swapper/1422:24:456
207312300,0sleep10-21swapper/122:39:461
197912300,27sleep90-21swapper/921:50:5815
153122300,2sleep515266-21sshd00:06:2911
120922300,1sleep00-21swapper/000:35:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional