You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 07:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Wed Jul 02, 2025 00:45:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134791212167,34phc2sys0-21swapper/319:09:163
52542205171,22sleep10-21swapper/119:07:001
54142203168,23sleep00-21swapper/019:09:050
52302203169,22sleep20-21swapper/219:06:502
3040821320,3sleep2578199cyclictest00:15:472
548828261,11sleep00-21swapper/019:10:010
5779996714,23cyclictest1531-21df_inode00:25:160
5782996411,11cyclictest1473-21cut20:05:193
5782996113,11cyclictest14512-21cat20:30:283
577999600,20cyclictest2476-21systemctl23:20:250
134991600,52ptp4l0-21swapper/319:10:013
578299589,16cyclictest18509-21apt-get23:55:163
236132580,2sleep00-21swapper/019:45:190
159652580,6sleep1578099cyclictest19:30:151
159652580,6sleep1578099cyclictest19:30:151
578299569,16cyclictest22654-21taskset19:43:113
578299558,17cyclictest29435-21irqstats23:10:193
578299538,13cyclictest19697-21ls22:50:263
5781995331,3cyclictest33-21ksoftirqd/221:35:102
578299529,18cyclictest25826-21diskstats22:00:173
578299529,18cyclictest25826-21diskstats22:00:163
578299518,13cyclictest1264-21snmpd20:41:043
578299477,14cyclictest1264-21snmpd21:46:163
578299470,44cyclictest8267-21basename00:40:003
578299467,13cyclictest1016-21hddtemp_smartct21:10:173
130891450,7getstats578299cyclictest19:26:543
578099430,41cyclictest0-21swapper/100:21:471
5781994219,21cyclictest11073-21kworker/2:219:50:272
134991420,0ptp4l401ktimersoftd/300:25:153
134991420,0ptp4l401ktimersoftd/300:08:593
134991400,1ptp4l391rcuc/321:15:193
578299399,17cyclictest364-21dbus-daemon22:30:263
5781993910,27cyclictest30262-21kworker/2:200:20:272
5782993812,11cyclictest29670-21systemd-cgroups21:01:363
5782993812,11cyclictest29670-21systemd-cgroups21:01:363
5780993833,3cyclictest25-21ksoftirqd/119:15:011
5781993730,4cyclictest33-21ksoftirqd/223:48:472
5780993731,4cyclictest25-21ksoftirqd/123:23:431
5780993731,4cyclictest25-21ksoftirqd/122:57:271
5780993731,4cyclictest25-21ksoftirqd/119:16:511
578299369,14cyclictest10453-21apt-get20:25:133
5781993630,4cyclictest33-21ksoftirqd/222:02:482
5781993630,4cyclictest33-21ksoftirqd/222:02:482
5781993630,4cyclictest33-21ksoftirqd/220:07:032
5781993630,4cyclictest33-21ksoftirqd/200:10:382
5781993629,4cyclictest33-21ksoftirqd/222:29:412
5780993630,4cyclictest25-21ksoftirqd/122:42:071
5780993630,4cyclictest25-21ksoftirqd/120:47:341
5780993630,4cyclictest25-21ksoftirqd/119:52:411
5780993629,5cyclictest25-21ksoftirqd/121:27:171
5780993629,4cyclictest25-21ksoftirqd/122:51:251
5780993629,4cyclictest25-21ksoftirqd/100:00:001
5779993631,3cyclictest9-21ksoftirqd/021:45:000
5779993631,3cyclictest9-21ksoftirqd/021:30:010
5779993630,4cyclictest9-21ksoftirqd/019:31:090
5779993630,4cyclictest9-21ksoftirqd/019:31:090
578299359,14cyclictest10205-21ssh23:35:303
5782993529,4cyclictest41-21ksoftirqd/323:45:113
5782993529,4cyclictest41-21ksoftirqd/323:16:273
5782993529,4cyclictest41-21ksoftirqd/323:02:393
5782993529,4cyclictest41-21ksoftirqd/323:02:393
5782993529,4cyclictest41-21ksoftirqd/320:57:583
5782993528,5cyclictest41-21ksoftirqd/300:05:003
5782993528,5cyclictest41-21ksoftirqd/300:05:003
5781993529,4cyclictest33-21ksoftirqd/223:35:432
5781993529,4cyclictest33-21ksoftirqd/223:01:372
5781993529,4cyclictest33-21ksoftirqd/223:01:372
5781993529,4cyclictest33-21ksoftirqd/222:39:272
5781993529,4cyclictest33-21ksoftirqd/222:11:552
5781993529,4cyclictest33-21ksoftirqd/219:19:122
5781993528,5cyclictest33-21ksoftirqd/219:23:172
5781993526,6cyclictest33-21ksoftirqd/221:05:132
5780993530,3cyclictest25-21ksoftirqd/119:35:131
5780993530,3cyclictest25-21ksoftirqd/100:03:471
5780993530,3cyclictest25-21ksoftirqd/100:03:471
5780993530,3cyclictest22801-21cron19:45:001
5780993529,4cyclictest25-21ksoftirqd/121:33:141
5780993529,4cyclictest25-21ksoftirqd/121:33:141
5779993530,3cyclictest9-21ksoftirqd/023:05:000
5779993530,3cyclictest9-21ksoftirqd/023:05:000
5779993529,4cyclictest9-21ksoftirqd/022:10:440
5779993529,4cyclictest9-21ksoftirqd/020:29:470
5779993529,4cyclictest9-21ksoftirqd/019:37:070
5779993529,4cyclictest9-21ksoftirqd/000:31:220
5779993529,3cyclictest9-21ksoftirqd/020:53:100
578299349,16cyclictest5496-21/usr/sbin/munin20:15:223
578299348,15cyclictest1621-21gnome-shell21:27:583
5782993429,3cyclictest41-21ksoftirqd/323:50:173
5782993428,4cyclictest41-21ksoftirqd/323:34:523
5782993428,4cyclictest41-21ksoftirqd/323:34:523
5782993428,4cyclictest41-21ksoftirqd/322:56:293
5782993428,4cyclictest41-21ksoftirqd/321:52:513
5782993428,4cyclictest41-21ksoftirqd/320:12:373
5782993428,4cyclictest41-21ksoftirqd/319:39:243
5782993428,4cyclictest41-21ksoftirqd/319:32:383
5782993428,4cyclictest41-21ksoftirqd/319:32:383
5782993428,3cyclictest41-21ksoftirqd/322:45:143
5781993429,3cyclictest33-21ksoftirqd/221:46:152
5781993429,3cyclictest33-21ksoftirqd/221:32:192
5781993429,3cyclictest33-21ksoftirqd/221:32:182
5781993428,4cyclictest33-21ksoftirqd/223:13:132
5781993428,4cyclictest33-21ksoftirqd/221:15:392
5781993428,4cyclictest33-21ksoftirqd/219:27:582
5781993427,5cyclictest33-21ksoftirqd/219:13:182
5781993427,4cyclictest33-21ksoftirqd/222:23:472
5780993429,3cyclictest25-21ksoftirqd/121:22:111
5780993428,4cyclictest25-21ksoftirqd/122:26:021
5780993428,4cyclictest25-21ksoftirqd/122:19:201
5780993428,4cyclictest25-21ksoftirqd/121:51:051
5780993428,4cyclictest25-21ksoftirqd/121:48:271
5780993428,4cyclictest25-21ksoftirqd/121:40:491
5780993428,4cyclictest25-21ksoftirqd/119:26:141
5780993428,4cyclictest25-21ksoftirqd/119:24:381
5780993428,4cyclictest25-21ksoftirqd/100:11:211
5780993427,4cyclictest25-21ksoftirqd/100:08:441
5779993428,4cyclictest9-21ksoftirqd/022:57:260
5779993428,4cyclictest9-21ksoftirqd/022:00:330
5779993428,4cyclictest9-21ksoftirqd/022:00:330
5779993428,4cyclictest9-21ksoftirqd/021:46:210
5779993428,4cyclictest9-21ksoftirqd/021:37:230
5779993428,4cyclictest9-21ksoftirqd/021:31:100
5779993428,4cyclictest9-21ksoftirqd/021:31:100
5779993428,4cyclictest9-21ksoftirqd/021:10:320
5779993428,4cyclictest9-21ksoftirqd/019:29:530
5779993428,4cyclictest9-21ksoftirqd/000:14:570
5779993428,4cyclictest9-21ksoftirqd/000:01:130
5779993428,4cyclictest9-21ksoftirqd/000:01:130
578299339,13cyclictest7791-21taskset22:27:113
578299334,21cyclictest0-21swapper/319:50:153
5782993327,4cyclictest41-21ksoftirqd/322:24:273
5782993327,4cyclictest41-21ksoftirqd/322:06:223
5782993327,4cyclictest41-21ksoftirqd/319:19:583
5782993327,4cyclictest41-21ksoftirqd/300:34:013
5781993328,3cyclictest33-21ksoftirqd/222:32:182
5781993328,3cyclictest33-21ksoftirqd/220:50:392
5781993327,4cyclictest33-21ksoftirqd/220:25:522
5781993327,4cyclictest33-21ksoftirqd/200:38:062
5781993327,4cyclictest33-21ksoftirqd/200:30:442
5781993327,4cyclictest33-21ksoftirqd/200:28:032
5781993327,4cyclictest33-21ksoftirqd/200:04:122
5781993327,4cyclictest33-21ksoftirqd/200:04:122
5781993326,4cyclictest33-21ksoftirqd/220:42:322
578199331,2cyclictest121rcu_preempt21:00:282
578199331,2cyclictest121rcu_preempt21:00:282
5780993328,3cyclictest25-21ksoftirqd/123:36:501
5780993328,3cyclictest25-21ksoftirqd/121:06:091
5780993327,4cyclictest25-21ksoftirqd/123:50:351
5780993327,4cyclictest25-21ksoftirqd/123:32:261
5780993327,4cyclictest25-21ksoftirqd/123:32:251
5780993327,4cyclictest25-21ksoftirqd/123:14:561
5780993327,4cyclictest25-21ksoftirqd/122:14:101
5780993327,4cyclictest25-21ksoftirqd/121:13:131
5780993327,4cyclictest25-21ksoftirqd/120:44:131
577999333,2cyclictest121rcu_preempt00:23:280
5779993328,3cyclictest9-21ksoftirqd/023:15:430
5779993327,4cyclictest9-21ksoftirqd/023:53:550
5779993327,4cyclictest9-21ksoftirqd/022:32:240
5779993315,15cyclictest12943-21sh22:40:010
578299329,7cyclictest1264-21snmpd21:06:073
578299325,10cyclictest0-21swapper/323:05:293
5782993227,3cyclictest41-21ksoftirqd/321:21:583
5782993226,4cyclictest41-21ksoftirqd/322:41:283
5782993226,4cyclictest41-21ksoftirqd/322:37:593
5782993226,4cyclictest41-21ksoftirqd/320:38:453
5782993226,4cyclictest41-21ksoftirqd/300:21:463
5782993226,3cyclictest41-21ksoftirqd/322:14:303
5782993226,3cyclictest41-21ksoftirqd/300:15:013
5781993227,3cyclictest33-21ksoftirqd/221:11:092
5781993227,3cyclictest33-21ksoftirqd/219:44:332
5781993226,4cyclictest33-21ksoftirqd/223:42:412
5781993226,4cyclictest33-21ksoftirqd/223:31:502
5781993226,4cyclictest33-21ksoftirqd/223:31:502
5781993226,4cyclictest33-21ksoftirqd/223:20:072
5781993226,4cyclictest33-21ksoftirqd/222:46:252
5781993226,4cyclictest33-21ksoftirqd/220:12:002
5781993226,3cyclictest33-21ksoftirqd/219:30:192
5781993226,3cyclictest33-21ksoftirqd/219:30:192
5781993225,4cyclictest33-21ksoftirqd/219:57:002
5781993225,4cyclictest33-21ksoftirqd/219:40:002
5780993227,3cyclictest25-21ksoftirqd/120:55:541
5780993227,3cyclictest25-21ksoftirqd/120:19:491
5780993227,3cyclictest25-21ksoftirqd/100:33:141
5780993226,4cyclictest25-21ksoftirqd/123:28:091
5780993226,4cyclictest25-21ksoftirqd/122:06:121
5780993226,4cyclictest25-21ksoftirqd/120:29:241
5780993226,4cyclictest25-21ksoftirqd/120:05:571
5780993226,4cyclictest25-21ksoftirqd/100:38:051
5780993226,4cyclictest25-21ksoftirqd/100:26:091
5779993227,3cyclictest9-21ksoftirqd/022:06:390
5779993227,3cyclictest9-21ksoftirqd/020:07:400
5779993226,4cyclictest9-21ksoftirqd/023:06:450
5779993226,4cyclictest9-21ksoftirqd/022:27:340
5779993226,4cyclictest9-21ksoftirqd/020:24:490
5779993226,4cyclictest9-21ksoftirqd/020:01:560
5779993226,4cyclictest9-21ksoftirqd/020:01:560
578299318,7cyclictest14913-21runrttasks21:38:213
5782993126,3cyclictest41-21ksoftirqd/323:27:213
5782993126,3cyclictest41-21ksoftirqd/321:55:133
5782993125,4cyclictest41-21ksoftirqd/321:44:563
5782993125,4cyclictest41-21ksoftirqd/321:34:173
5782993125,4cyclictest41-21ksoftirqd/321:34:173
5782993125,4cyclictest41-21ksoftirqd/320:03:583
5782993125,4cyclictest41-21ksoftirqd/320:03:583
5782993125,4cyclictest41-21ksoftirqd/319:23:233
5781993126,3cyclictest33-21ksoftirqd/223:56:442
5781993126,3cyclictest33-21ksoftirqd/223:15:542
5781993126,3cyclictest33-21ksoftirqd/221:59:472
5781993126,3cyclictest33-21ksoftirqd/220:00:332
5781993126,3cyclictest33-21ksoftirqd/220:00:332
5781993125,4cyclictest33-21ksoftirqd/220:36:352
5780993125,4cyclictest25-21ksoftirqd/123:40:081
5780993125,4cyclictest25-21ksoftirqd/123:09:391
5780993125,3cyclictest25-21ksoftirqd/122:20:351
5780993125,3cyclictest25-21ksoftirqd/120:00:271
5780993125,3cyclictest25-21ksoftirqd/120:00:271
5779993126,3cyclictest9-21ksoftirqd/022:22:200
5779993126,3cyclictest9-21ksoftirqd/021:18:580
5779993126,3cyclictest9-21ksoftirqd/020:46:160
5779993126,3cyclictest9-21ksoftirqd/020:17:000
5779993126,3cyclictest9-21ksoftirqd/020:12:450
5779993126,3cyclictest9-21ksoftirqd/000:38:400
5779993125,4cyclictest9-21ksoftirqd/023:38:540
5779993125,4cyclictest9-21ksoftirqd/023:25:340
5779993125,4cyclictest9-21ksoftirqd/023:13:440
5779993125,4cyclictest9-21ksoftirqd/022:50:320
5779993125,4cyclictest9-21ksoftirqd/022:44:300
5779993125,4cyclictest9-21ksoftirqd/021:22:270
5779993125,4cyclictest9-21ksoftirqd/021:08:110
5779993125,4cyclictest9-21ksoftirqd/021:03:290
5779993125,4cyclictest9-21ksoftirqd/021:03:290
5779993125,4cyclictest9-21ksoftirqd/019:50:480
5779993125,4cyclictest9-21ksoftirqd/019:23:310
5779993125,4cyclictest9-21ksoftirqd/019:19:540
5779993123,5cyclictest9-21ksoftirqd/023:40:030
5782993024,4cyclictest41-21ksoftirqd/323:43:433
5782993024,4cyclictest41-21ksoftirqd/322:19:343
5782993024,4cyclictest41-21ksoftirqd/320:53:453
5782993024,4cyclictest41-21ksoftirqd/320:23:323
5782993024,4cyclictest41-21ksoftirqd/319:45:533
5782993014,13cyclictest28908-21df_abs00:15:143
5781993025,3cyclictest33-21ksoftirqd/221:26:132
5781993024,4cyclictest33-21ksoftirqd/200:08:152
5781993024,3cyclictest33-21ksoftirqd/221:41:542
5781993023,5cyclictest33-21ksoftirqd/222:18:022
5780993025,3cyclictest25-21ksoftirqd/121:58:261
5780993025,3cyclictest25-21ksoftirqd/121:19:221
5780993025,3cyclictest25-21ksoftirqd/120:30:591
5780993025,3cyclictest25-21ksoftirqd/120:21:431
5780993025,3cyclictest25-21ksoftirqd/120:10:371
5780993025,3cyclictest25-21ksoftirqd/119:57:251
5780993024,4cyclictest25-21ksoftirqd/122:30:141
5780993024,4cyclictest25-21ksoftirqd/121:35:311
5779993025,3cyclictest9-21ksoftirqd/023:31:430
5779993025,3cyclictest9-21ksoftirqd/023:31:430
5779993024,4cyclictest9-21ksoftirqd/023:49:250
5779993024,4cyclictest9-21ksoftirqd/019:43:170
5782992924,3cyclictest41-21ksoftirqd/319:57:173
5782992923,4cyclictest41-21ksoftirqd/320:46:283
5781992924,3cyclictest33-21ksoftirqd/223:53:552
5781992924,3cyclictest33-21ksoftirqd/222:52:292
5781992923,4cyclictest33-21ksoftirqd/222:59:412
5781992923,4cyclictest33-21ksoftirqd/222:08:262
5781992923,3cyclictest33-21ksoftirqd/219:47:242
578199291,14cyclictest3950-21diskstats23:25:192
5780992924,3cyclictest25-21ksoftirqd/122:01:561
5780992924,3cyclictest25-21ksoftirqd/122:01:551
5780992923,4cyclictest25-21ksoftirqd/122:39:581
5779992924,3cyclictest9-21ksoftirqd/019:58:230
5779992924,3cyclictest9-21ksoftirqd/000:07:470
5779992910,16cyclictest29533-21cut00:15:190
5779992910,16cyclictest19669-21cat23:55:260
5781992823,3cyclictest33-21ksoftirqd/223:07:102
5781992822,4cyclictest33-21ksoftirqd/221:23:582
5781992822,4cyclictest33-21ksoftirqd/220:56:152
578199280,2cyclictest5510-21apt-get20:15:112
5780992823,3cyclictest25-21ksoftirqd/123:19:591
5780992822,4cyclictest25-21ksoftirqd/100:19:591
5779992823,3cyclictest9-21ksoftirqd/022:45:130
5779992810,16cyclictest970-21expr22:15:200
5779992810,16cyclictest26619-21ptp4l-jitter20:55:240
5781992722,3cyclictest33-21ksoftirqd/220:32:542
5781992722,3cyclictest15433-21sh22:45:002
5781992721,4cyclictest33-21ksoftirqd/221:53:142
5780992722,3cyclictest25-21ksoftirqd/123:47:021
577999273,21cyclictest16022-21awk20:35:200
5779992721,4cyclictest9-21ksoftirqd/020:43:510
577999270,1cyclictest0-21swapper/020:30:150
5780992620,4cyclictest25-21ksoftirqd/119:46:571
5780992520,3cyclictest25-21ksoftirqd/123:01:461
5780992520,3cyclictest25-21ksoftirqd/123:01:461
577999250,22cyclictest22648-21uname21:54:590
577999250,1cyclictest0-21swapper/021:55:160
578199244,18cyclictest0-21swapper/220:48:152
578199240,11cyclictest0-21swapper/220:21:112
5780992419,3cyclictest25-21ksoftirqd/120:52:571
134991240,0ptp4l401ktimersoftd/323:20:183
5780992318,3cyclictest25-21ksoftirqd/122:49:591
5780992317,4cyclictest25-21ksoftirqd/120:39:441
5780992116,3cyclictest25-21ksoftirqd/121:02:121
5780992116,3cyclictest25-21ksoftirqd/121:02:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional