You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 19:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot3.osadl.org (updated Thu Dec 11, 2025 12:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137191206172,22phc2sys0-21swapper/307:05:033
41042198165,22sleep00-21swapper/007:09:410
40562198164,22sleep20-21swapper/207:09:032
18872197163,23sleep10-21swapper/107:05:041
3149021790,6sleep0443099cyclictest08:05:170
606021640,4sleep0443099cyclictest09:25:230
1369911000,0ptp4l391rcuc/312:05:283
244222600,2sleep30-21swapper/307:50:193
244222600,2sleep30-21swapper/307:50:193
443399595,16cyclictest223-21systemd-journal12:38:513
136991540,1ptp4l391rcuc/307:25:253
443399524,16cyclictest9441-21/usr/sbin/munin09:35:273
443399513,16cyclictest4464-21apt-get07:10:123
443399513,15cyclictest16544-21/usr/sbin/munin07:35:173
136991440,0ptp4l401ktimersoftd/308:42:483
4431994333,7cyclictest25-21ksoftirqd/111:40:011
136991430,1ptp4l0-21swapper/309:52:453
136991430,0ptp4l401ktimersoftd/312:21:193
136991430,0ptp4l401ktimersoftd/309:56:263
136991430,0ptp4l401ktimersoftd/309:17:503
136991430,0ptp4l401ktimersoftd/308:55:553
59298420,9rtkit-daemon0-21swapper/109:05:171
443399425,7cyclictest1555-21df10:25:153
136991420,0ptp4l401ktimersoftd/311:20:023
136991410,0ptp4l401ktimersoftd/310:42:433
136991400,0ptp4l401ktimersoftd/308:51:383
136991400,0ptp4l401ktimersoftd/308:51:383
4431993934,3cyclictest25-21ksoftirqd/110:40:011
4433993833,3cyclictest41-21ksoftirqd/308:10:003
4432993832,4cyclictest33-21ksoftirqd/207:11:072
443399374,14cyclictest1359-21ssh11:30:273
443399373,14cyclictest14031-21meminfo08:35:223
4432993731,4cyclictest33-21ksoftirqd/212:19:492
4431993732,3cyclictest25-21ksoftirqd/109:00:001
59298360,2rtkit-daemon0-21swapper/010:00:150
443399363,14cyclictest1285-21snmpd10:14:143
4433993630,4cyclictest41-21ksoftirqd/307:24:123
4432993630,4cyclictest33-21ksoftirqd/210:48:262
4432993630,4cyclictest33-21ksoftirqd/207:39:312
4431993630,4cyclictest25-21ksoftirqd/107:45:401
4431993630,3cyclictest25-21ksoftirqd/111:00:001
4431993629,5cyclictest25-21ksoftirqd/109:51:371
443199361,33cyclictest13971-21cron09:44:591
4430993629,5cyclictest9-21ksoftirqd/009:05:000
304562360,22sleep233-21ksoftirqd/209:10:182
136991360,0ptp4l401ktimersoftd/308:25:133
4433993529,4cyclictest41-21ksoftirqd/309:45:533
4433993529,4cyclictest41-21ksoftirqd/308:34:233
4432993530,3cyclictest33-21ksoftirqd/207:42:232
4432993529,4cyclictest33-21ksoftirqd/211:43:062
4432993529,4cyclictest33-21ksoftirqd/210:36:542
4432993528,5cyclictest33-21ksoftirqd/210:52:202
4431993531,3cyclictest25-21ksoftirqd/111:50:001
4431993531,3cyclictest25-21ksoftirqd/109:20:001
4431993531,3cyclictest25-21ksoftirqd/107:30:001
4431993529,4cyclictest25-21ksoftirqd/111:18:421
59298340,3rtkit-daemon11990-21/usr/sbin/munin07:25:150
4433993428,4cyclictest41-21ksoftirqd/311:16:203
4433993428,4cyclictest41-21ksoftirqd/309:00:433
4433993428,4cyclictest41-21ksoftirqd/307:45:343
4433993427,4cyclictest41-21ksoftirqd/307:44:543
4432993429,3cyclictest33-21ksoftirqd/207:19:542
4432993428,4cyclictest33-21ksoftirqd/212:32:002
4432993428,4cyclictest33-21ksoftirqd/211:57:382
4432993428,4cyclictest33-21ksoftirqd/211:11:332
4432993428,4cyclictest33-21ksoftirqd/210:34:062
4432993428,4cyclictest33-21ksoftirqd/210:34:052
4432993428,4cyclictest33-21ksoftirqd/209:58:082
4432993428,4cyclictest33-21ksoftirqd/209:47:412
4432993428,4cyclictest33-21ksoftirqd/209:19:332
4432993428,4cyclictest33-21ksoftirqd/208:58:422
4432993427,5cyclictest33-21ksoftirqd/207:20:582
4431993430,3cyclictest25-21ksoftirqd/109:50:001
4431993429,3cyclictest25-21ksoftirqd/111:45:001
4431993429,3cyclictest25-21ksoftirqd/108:10:001
4431993428,4cyclictest25-21ksoftirqd/110:32:051
4431993428,4cyclictest25-21ksoftirqd/110:32:041
4431993428,4cyclictest25-21ksoftirqd/108:21:061
4431993428,4cyclictest25-21ksoftirqd/108:14:491
4431993427,5cyclictest25-21ksoftirqd/107:31:321
4431993427,4cyclictest25-21ksoftirqd/110:40:351
4431993427,4cyclictest21616-21turbostat12:15:001
4430993428,4cyclictest9-21ksoftirqd/007:14:220
59298330,2rtkit-daemon0-21swapper/112:03:121
59298330,2rtkit-daemon0-21swapper/010:15:160
4433993328,3cyclictest41-21ksoftirqd/308:15:123
4433993328,3cyclictest41-21ksoftirqd/308:04:163
4433993327,4cyclictest41-21ksoftirqd/312:17:213
4433993327,4cyclictest41-21ksoftirqd/311:49:053
4433993327,4cyclictest41-21ksoftirqd/310:22:473
4433993327,4cyclictest41-21ksoftirqd/309:40:473
4433993327,4cyclictest41-21ksoftirqd/309:06:303
4432993328,3cyclictest33-21ksoftirqd/210:59:042
4432993328,3cyclictest33-21ksoftirqd/208:54:572
4432993328,3cyclictest33-21ksoftirqd/208:54:562
4432993328,3cyclictest33-21ksoftirqd/207:32:322
4432993327,4cyclictest33-21ksoftirqd/212:22:412
4432993327,4cyclictest33-21ksoftirqd/210:11:072
4432993327,4cyclictest33-21ksoftirqd/208:30:382
4431993328,3cyclictest25-21ksoftirqd/112:10:001
4431993328,3cyclictest25-21ksoftirqd/112:00:011
4431993327,4cyclictest25-21ksoftirqd/111:07:141
4431993327,4cyclictest25-21ksoftirqd/110:46:131
4431993327,3cyclictest25-21ksoftirqd/112:15:181
4431993326,5cyclictest25-21ksoftirqd/112:31:241
4430993327,4cyclictest9-21ksoftirqd/010:43:180
4430993327,4cyclictest9-21ksoftirqd/009:15:370
4430993327,4cyclictest9-21ksoftirqd/008:56:160
4430993327,4cyclictest9-21ksoftirqd/008:36:220
4430993327,4cyclictest9-21ksoftirqd/008:14:020
4430993327,3cyclictest9-21ksoftirqd/010:00:010
4433993228,3cyclictest41-21ksoftirqd/307:33:233
4433993226,4cyclictest41-21ksoftirqd/311:30:003
4433993226,4cyclictest41-21ksoftirqd/311:03:473
4433993226,4cyclictest41-21ksoftirqd/310:52:173
4433993226,4cyclictest41-21ksoftirqd/310:49:003
4433993226,4cyclictest41-21ksoftirqd/310:02:183
4433993226,4cyclictest41-21ksoftirqd/307:58:143
4432993227,3cyclictest33-21ksoftirqd/211:30:082
4432993227,3cyclictest33-21ksoftirqd/211:18:342
4432993227,3cyclictest33-21ksoftirqd/211:06:262
4432993227,3cyclictest33-21ksoftirqd/211:02:522
4432993227,3cyclictest33-21ksoftirqd/209:34:172
4432993227,3cyclictest33-21ksoftirqd/208:19:522
4432993227,3cyclictest33-21ksoftirqd/207:49:442
4432993226,4cyclictest33-21ksoftirqd/212:28:352
4432993226,4cyclictest33-21ksoftirqd/211:48:552
4432993226,4cyclictest33-21ksoftirqd/211:29:102
4432993226,4cyclictest33-21ksoftirqd/208:02:382
4432993226,4cyclictest33-21ksoftirqd/207:50:352
4432993226,4cyclictest33-21ksoftirqd/207:50:352
4432993225,4cyclictest33-21ksoftirqd/211:24:372
4431993228,2cyclictest25-21ksoftirqd/110:24:591
4431993228,2cyclictest25-21ksoftirqd/109:35:011
4431993227,3cyclictest25-21ksoftirqd/109:25:001
4431993227,3cyclictest25-21ksoftirqd/109:05:001
4431993226,4cyclictest25-21ksoftirqd/111:03:051
4431993226,4cyclictest25-21ksoftirqd/110:05:451
4431993226,4cyclictest25-21ksoftirqd/108:52:361
4431993226,4cyclictest25-21ksoftirqd/108:52:361
4430993227,3cyclictest9-21ksoftirqd/011:36:060
4430993227,3cyclictest9-21ksoftirqd/009:23:310
4430993226,4cyclictest9-21ksoftirqd/012:21:400
4430993226,4cyclictest9-21ksoftirqd/011:08:340
4430993226,4cyclictest9-21ksoftirqd/010:13:290
4430993226,4cyclictest9-21ksoftirqd/009:07:510
4430993226,4cyclictest9-21ksoftirqd/008:41:190
4430993226,4cyclictest9-21ksoftirqd/007:54:300
4430993226,4cyclictest9-21ksoftirqd/007:54:300
4430993225,4cyclictest9-21ksoftirqd/012:28:170
4433993126,3cyclictest41-21ksoftirqd/312:01:043
4433993125,4cyclictest41-21ksoftirqd/312:31:343
4433993125,4cyclictest41-21ksoftirqd/311:14:033
4433993125,4cyclictest41-21ksoftirqd/310:19:353
4432993126,3cyclictest33-21ksoftirqd/209:25:312
4432993126,3cyclictest33-21ksoftirqd/207:27:062
4432993125,4cyclictest33-21ksoftirqd/212:07:222
4432993125,4cyclictest33-21ksoftirqd/210:18:142
4432993125,4cyclictest33-21ksoftirqd/209:01:072
4432993125,4cyclictest33-21ksoftirqd/207:55:082
4431993127,3cyclictest25-21ksoftirqd/111:25:001
4431993125,4cyclictest25-21ksoftirqd/112:39:381
4431993125,4cyclictest25-21ksoftirqd/111:51:321
4431993125,4cyclictest25-21ksoftirqd/110:14:561
4431993125,4cyclictest25-21ksoftirqd/109:10:371
4431993125,4cyclictest25-21ksoftirqd/108:46:501
4431993125,4cyclictest25-21ksoftirqd/108:17:121
4431993124,5cyclictest25-21ksoftirqd/109:30:001
4430993126,3cyclictest9-21ksoftirqd/011:15:450
4430993126,3cyclictest9-21ksoftirqd/007:15:100
4430993125,4cyclictest9-21ksoftirqd/011:43:240
4430993125,4cyclictest9-21ksoftirqd/011:33:090
4430993125,4cyclictest9-21ksoftirqd/009:43:170
4430993125,4cyclictest9-21ksoftirqd/007:21:480
4433993024,4cyclictest41-21ksoftirqd/311:50:583
4433993024,4cyclictest41-21ksoftirqd/309:21:023
4432993025,3cyclictest33-21ksoftirqd/210:42:542
4432993024,4cyclictest33-21ksoftirqd/211:39:452
4432993024,4cyclictest33-21ksoftirqd/209:23:092
4432993024,4cyclictest33-21ksoftirqd/208:46:542
4432993023,5cyclictest33-21ksoftirqd/210:22:592
4431993026,3cyclictest25-21ksoftirqd/107:20:181
4431993024,4cyclictest25-21ksoftirqd/109:36:041
4431993023,5cyclictest25-21ksoftirqd/108:03:371
4431993023,5cyclictest25-21ksoftirqd/107:40:021
443199301,2cyclictest121rcu_preempt07:55:381
4430993025,3cyclictest9-21ksoftirqd/012:08:140
4430993025,3cyclictest9-21ksoftirqd/011:51:450
4430993025,3cyclictest9-21ksoftirqd/009:49:550
4430993025,3cyclictest9-21ksoftirqd/008:33:530
4430993025,3cyclictest5616-21cron08:20:000
4430993024,4cyclictest9-21ksoftirqd/012:13:050
4430993024,4cyclictest9-21ksoftirqd/011:22:310
4433992924,3cyclictest41-21ksoftirqd/309:32:443
4433992923,4cyclictest41-21ksoftirqd/311:59:153
4432992924,3cyclictest33-21ksoftirqd/212:13:252
4432992924,3cyclictest33-21ksoftirqd/209:53:182
4432992923,4cyclictest33-21ksoftirqd/210:00:372
4432992923,4cyclictest33-21ksoftirqd/208:26:572
4432992923,4cyclictest33-21ksoftirqd/208:20:032
4431992924,3cyclictest25-21ksoftirqd/110:00:061
4431992924,3cyclictest25-21ksoftirqd/108:32:121
4431992924,3cyclictest25-21ksoftirqd/107:39:381
4431992923,4cyclictest25-21ksoftirqd/107:18:201
4431992922,5cyclictest25-21ksoftirqd/110:20:001
4430992924,3cyclictest9-21ksoftirqd/012:16:460
4430992924,3cyclictest9-21ksoftirqd/010:57:430
4430992924,3cyclictest9-21ksoftirqd/010:36:420
4430992923,4cyclictest9-21ksoftirqd/012:37:480
4430992923,4cyclictest9-21ksoftirqd/011:55:350
4430992923,4cyclictest9-21ksoftirqd/010:05:430
4430992923,4cyclictest9-21ksoftirqd/007:34:360
4433992823,3cyclictest41-21ksoftirqd/308:48:233
4433992823,3cyclictest41-21ksoftirqd/307:17:003
4433992822,4cyclictest41-21ksoftirqd/312:10:393
4433992822,4cyclictest41-21ksoftirqd/310:30:213
4433992822,4cyclictest41-21ksoftirqd/310:30:213
4433992822,4cyclictest41-21ksoftirqd/308:20:113
4432992823,3cyclictest33-21ksoftirqd/212:35:422
4432992823,3cyclictest33-21ksoftirqd/209:41:282
4432992823,3cyclictest33-21ksoftirqd/208:42:262
4432992823,3cyclictest33-21ksoftirqd/208:05:352
4432992822,4cyclictest33-21ksoftirqd/208:36:242
4431992823,3cyclictest25-21ksoftirqd/108:40:201
4431992823,3cyclictest25-21ksoftirqd/107:51:251
4431992823,3cyclictest25-21ksoftirqd/107:51:241
4431992822,4cyclictest25-21ksoftirqd/111:30:461
4431992822,4cyclictest25-21ksoftirqd/111:10:311
4430992823,3cyclictest9-21ksoftirqd/010:51:230
4430992822,4cyclictest9-21ksoftirqd/011:48:170
4430992822,4cyclictest9-21ksoftirqd/010:34:570
4430992822,4cyclictest9-21ksoftirqd/010:34:570
4430992822,4cyclictest9-21ksoftirqd/010:29:310
4430992821,5cyclictest9-21ksoftirqd/009:36:400
4433992722,3cyclictest41-21ksoftirqd/311:09:343
4433992721,4cyclictest41-21ksoftirqd/311:43:043
4433992721,4cyclictest41-21ksoftirqd/310:56:453
4431992723,3cyclictest25-21ksoftirqd/112:25:271
4431992722,3cyclictest25-21ksoftirqd/112:23:351
4431992722,3cyclictest25-21ksoftirqd/110:50:441
4431992721,4cyclictest25-21ksoftirqd/110:29:231
4430992722,3cyclictest9-21ksoftirqd/009:31:550
4430992721,4cyclictest9-21ksoftirqd/008:46:130
4430992721,4cyclictest9-21ksoftirqd/007:56:060
59298260,1rtkit-daemon0-21swapper/011:01:280
4433992621,3cyclictest41-21ksoftirqd/311:35:183
4433992621,3cyclictest41-21ksoftirqd/310:38:083
4433992620,4cyclictest41-21ksoftirqd/309:28:403
4432992621,3cyclictest33-21ksoftirqd/212:04:012
4431992621,3cyclictest25-21ksoftirqd/111:25:051
4430992621,3cyclictest9-21ksoftirqd/012:33:260
4430992621,3cyclictest9-21ksoftirqd/010:48:450
4430992621,3cyclictest9-21ksoftirqd/007:36:170
4430992620,3cyclictest9-21ksoftirqd/011:10:540
4432992520,3cyclictest33-21ksoftirqd/211:51:222
4432992520,3cyclictest33-21ksoftirqd/209:36:012
4432992520,3cyclictest33-21ksoftirqd/208:12:152
4431992519,4cyclictest25-21ksoftirqd/107:12:061
4430992520,3cyclictest9-21ksoftirqd/008:50:590
4430992520,3cyclictest9-21ksoftirqd/008:50:580
4430992519,4cyclictest9-21ksoftirqd/008:29:160
4430992519,4cyclictest9-21ksoftirqd/007:48:480
136991250,0ptp4l401ktimersoftd/310:05:133
443399247,14cyclictest30288-21fschecks_count09:10:163
4431992419,3cyclictest25-21ksoftirqd/108:25:201
4431992418,4cyclictest25-21ksoftirqd/109:55:191
4430992419,3cyclictest9-21ksoftirqd/009:10:040
4430992418,4cyclictest9-21ksoftirqd/008:21:130
239432240,6sleep2443299cyclictest10:05:132
136991240,0ptp4l401ktimersoftd/308:10:123
136991230,0ptp4l401ktimersoftd/312:25:013
4432992216,4cyclictest33-21ksoftirqd/209:06:332
4431992217,3cyclictest25-21ksoftirqd/108:35:281
4430992217,3cyclictest9-21ksoftirqd/009:54:350
4432992115,4cyclictest33-21ksoftirqd/210:29:532
4430992116,3cyclictest9-21ksoftirqd/010:25:000
4430992116,3cyclictest9-21ksoftirqd/008:04:530
59298200,2rtkit-daemon0-21swapper/012:04:560
4430992015,3cyclictest9-21ksoftirqd/011:28:250
4430991813,3cyclictest20444-21threads07:40:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional