You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 13:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Sat Jul 12, 2025 00:45:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39892206172,22sleep10-21swapper/119:07:381
137191205170,23phc2sys0-21swapper/319:07:013
39832202168,23sleep00-21swapper/019:07:320
39532202169,22sleep20-21swapper/219:07:102
192992720,2sleep00-21swapper/020:45:240
169352630,8sleep1446499cyclictest00:05:001
446499555,3cyclictest244822chrt20:56:051
4464995145,3cyclictest25813-21sh19:55:011
27312510,2sleep30-21swapper/321:20:183
446699501,16cyclictest27478-21/usr/sbin/munin21:05:253
446699471,15cyclictest12961-21/usr/sbin/munin20:35:233
446699471,13cyclictest31979-21apt-get21:15:033
4464994611,21cyclictest21554-21seq00:12:251
446699450,17cyclictest25055-21/usr/sbin/munin21:00:173
136991450,0ptp4l401ktimersoftd/322:52:063
446499441,3cyclictest223-21systemd-journal22:07:241
136991420,0ptp4l401ktimersoftd/320:12:033
446699411,8cyclictest9705-21ls22:40:243
446699411,16cyclictest1168-21/usr/sbin/munin22:25:253
446699410,15cyclictest10594-21/usr/sbin/munin20:30:243
446699410,13cyclictest1285-21snmpd20:04:453
136991410,0ptp4l401ktimersoftd/320:16:213
136991410,0ptp4l401ktimersoftd/319:45:523
446699391,16cyclictest14702-21/usr/sbin/munin00:00:203
446699381,7cyclictest20678-21memory00:10:233
59298370,3rtkit-daemon566-21irqbalance21:13:260
446699370,7cyclictest24298-21memory23:10:253
4465993731,4cyclictest33-21ksoftirqd/223:41:142
4465993731,4cyclictest33-21ksoftirqd/220:05:442
4464993731,4cyclictest25-21ksoftirqd/123:05:001
4464993711,25cyclictest30483-21kworker/1:122:52:471
4463993732,3cyclictest9-21ksoftirqd/020:20:010
446699361,21cyclictest0-21swapper/323:25:123
4465993631,3cyclictest33-21ksoftirqd/220:41:212
4465993630,3cyclictest33-21ksoftirqd/222:22:272
4465993630,3cyclictest33-21ksoftirqd/222:22:272
4464993631,3cyclictest28891-21cron00:29:591
4464993629,4cyclictest25-21ksoftirqd/123:05:071
4464993629,4cyclictest25-21ksoftirqd/122:38:511
4463993631,3cyclictest9-21ksoftirqd/022:40:000
4466993530,3cyclictest41-21ksoftirqd/322:14:383
4466993529,4cyclictest41-21ksoftirqd/319:42:583
4465993529,4cyclictest33-21ksoftirqd/222:43:382
4464993529,4cyclictest25-21ksoftirqd/123:54:171
4464993529,4cyclictest25-21ksoftirqd/123:36:571
4464993529,4cyclictest25-21ksoftirqd/122:28:411
4464993529,4cyclictest25-21ksoftirqd/121:08:121
4464993529,4cyclictest25-21ksoftirqd/120:00:401
4464993529,4cyclictest25-21ksoftirqd/119:23:511
4464993528,5cyclictest25-21ksoftirqd/123:34:561
446499351,3cyclictest0-21swapper/123:14:441
4463993530,3cyclictest31273-21sh00:35:000
4466993429,3cyclictest41-21ksoftirqd/300:37:563
4466993429,3cyclictest20642-21cron23:05:003
4466993428,4cyclictest41-21ksoftirqd/323:50:503
4466993428,4cyclictest41-21ksoftirqd/323:47:133
4466993428,4cyclictest41-21ksoftirqd/323:31:533
4466993428,4cyclictest41-21ksoftirqd/322:55:193
4466993428,4cyclictest41-21ksoftirqd/320:24:183
4466993428,4cyclictest41-21ksoftirqd/319:56:143
4466993428,4cyclictest41-21ksoftirqd/319:34:443
4466993428,4cyclictest41-21ksoftirqd/319:34:433
4466993428,4cyclictest41-21ksoftirqd/319:18:273
4465993430,3cyclictest33-21ksoftirqd/220:36:222
4465993428,4cyclictest33-21ksoftirqd/223:33:282
4465993428,4cyclictest33-21ksoftirqd/223:23:212
4465993428,4cyclictest33-21ksoftirqd/222:37:152
4465993428,4cyclictest33-21ksoftirqd/222:12:042
4465993428,4cyclictest33-21ksoftirqd/221:53:192
4465993428,4cyclictest33-21ksoftirqd/221:34:332
4465993428,4cyclictest33-21ksoftirqd/220:32:392
4464993428,4cyclictest25-21ksoftirqd/123:59:221
4464993428,4cyclictest25-21ksoftirqd/123:28:421
4464993428,4cyclictest25-21ksoftirqd/123:23:041
4464993428,4cyclictest25-21ksoftirqd/121:20:041
4464993428,4cyclictest25-21ksoftirqd/121:19:311
4464993428,4cyclictest25-21ksoftirqd/120:06:381
4464993428,4cyclictest25-21ksoftirqd/119:25:121
4464993427,4cyclictest25-21ksoftirqd/119:12:111
4464993416,15cyclictest14112-21latency_hist21:45:011
446499340,3cyclictest7146-21cstates19:15:161
4463993429,3cyclictest9-21ksoftirqd/022:46:340
4463993429,3cyclictest9-21ksoftirqd/000:00:220
4466993328,3cyclictest41-21ksoftirqd/323:15:123
4466993327,4cyclictest41-21ksoftirqd/323:23:033
4466993327,4cyclictest41-21ksoftirqd/321:29:053
4466993327,4cyclictest41-21ksoftirqd/320:52:053
4466993327,4cyclictest41-21ksoftirqd/320:27:033
4465993328,3cyclictest33-21ksoftirqd/222:58:192
4465993328,3cyclictest33-21ksoftirqd/200:37:352
4465993327,4cyclictest33-21ksoftirqd/223:52:492
4465993327,4cyclictest33-21ksoftirqd/219:45:092
4465993327,4cyclictest33-21ksoftirqd/200:17:052
4465993327,4cyclictest33-21ksoftirqd/200:05:492
4465993327,4cyclictest33-21ksoftirqd/200:05:492
4465993327,3cyclictest33-21ksoftirqd/200:35:002
4464993328,3cyclictest25-21ksoftirqd/123:41:451
4464993328,3cyclictest25-21ksoftirqd/120:35:281
4464993327,4cyclictest25-21ksoftirqd/123:16:391
4464993327,4cyclictest25-21ksoftirqd/122:23:071
4464993327,4cyclictest25-21ksoftirqd/122:23:071
4464993327,4cyclictest25-21ksoftirqd/121:56:301
4464993327,4cyclictest25-21ksoftirqd/119:35:421
4464993327,4cyclictest25-21ksoftirqd/100:17:091
4464993326,5cyclictest25-21ksoftirqd/121:33:571
446499330,4cyclictest19152-21cut20:45:241
446499330,3cyclictest3906-21fschecks_count20:15:151
446499330,3cyclictest19962-21sed19:40:241
4463993327,4cyclictest9-21ksoftirqd/022:42:200
4463993327,4cyclictest9-21ksoftirqd/022:01:200
4463993327,4cyclictest9-21ksoftirqd/019:13:170
4466993227,3cyclictest41-21ksoftirqd/320:56:113
4466993226,4cyclictest41-21ksoftirqd/322:32:313
4466993226,4cyclictest41-21ksoftirqd/322:20:523
4466993226,4cyclictest41-21ksoftirqd/322:20:523
4466993226,4cyclictest41-21ksoftirqd/321:46:293
4466993226,4cyclictest41-21ksoftirqd/321:44:463
4466993226,4cyclictest41-21ksoftirqd/319:22:163
4466993226,4cyclictest41-21ksoftirqd/300:17:103
4465993227,3cyclictest33-21ksoftirqd/220:51:392
4465993226,4cyclictest33-21ksoftirqd/223:05:442
4465993226,4cyclictest33-21ksoftirqd/222:00:502
4465993226,4cyclictest33-21ksoftirqd/221:09:062
4465993226,4cyclictest33-21ksoftirqd/200:15:002
4464993227,3cyclictest25-21ksoftirqd/121:14:141
4464993226,4cyclictest25-21ksoftirqd/122:11:471
4464993226,4cyclictest25-21ksoftirqd/121:00:541
4464993226,3cyclictest25-21ksoftirqd/121:50:021
4464993216,13cyclictest26539-21idleruntime-cro00:25:001
4464993213,16cyclictest21934-21sed20:50:271
446499321,28cyclictest32218-21tune2fs00:35:171
446499320,4cyclictest23191-21grep22:00:311
4463993227,3cyclictest9-21ksoftirqd/022:59:250
4463993227,3cyclictest9-21ksoftirqd/021:35:030
4463993226,4cyclictest9-21ksoftirqd/023:44:410
4463993225,4cyclictest9-21ksoftirqd/000:22:520
4463993224,5cyclictest9-21ksoftirqd/023:00:080
4466993126,3cyclictest41-21ksoftirqd/321:57:083
4466993126,3cyclictest41-21ksoftirqd/321:37:403
4466993125,4cyclictest41-21ksoftirqd/323:41:153
4466993125,4cyclictest41-21ksoftirqd/321:53:473
4466993125,4cyclictest41-21ksoftirqd/320:44:563
446699312,18cyclictest0-21swapper/300:20:113
446599318,11cyclictest2011-21kworker/2:221:23:392
4465993126,3cyclictest33-21ksoftirqd/222:52:032
4465993126,3cyclictest33-21ksoftirqd/220:26:072
4465993126,3cyclictest33-21ksoftirqd/219:24:142
4465993125,4cyclictest33-21ksoftirqd/222:33:342
4465993125,4cyclictest33-21ksoftirqd/221:02:042
4465993125,4cyclictest33-21ksoftirqd/220:00:542
4465993125,4cyclictest33-21ksoftirqd/219:30:582
4465993125,4cyclictest33-21ksoftirqd/219:30:582
4465993125,4cyclictest33-21ksoftirqd/219:14:242
4465993125,4cyclictest33-21ksoftirqd/200:23:472
4464993126,3cyclictest25-21ksoftirqd/120:33:501
4464993126,3cyclictest25-21ksoftirqd/119:56:551
4464993125,4cyclictest25-21ksoftirqd/122:33:211
4464993125,4cyclictest25-21ksoftirqd/100:05:321
4464993125,4cyclictest25-21ksoftirqd/100:05:321
4464993124,5cyclictest25-21ksoftirqd/119:31:561
4464993124,5cyclictest25-21ksoftirqd/119:31:561
4464993124,4cyclictest25-21ksoftirqd/119:49:421
446499310,3cyclictest17357-21phc2sys-jitter22:55:231
446499310,3cyclictest0-21swapper/120:10:111
4463993126,3cyclictest9-21ksoftirqd/022:06:260
4463993126,3cyclictest9-21ksoftirqd/019:42:140
4463993126,3cyclictest9-21ksoftirqd/019:35:120
4463993125,4cyclictest9-21ksoftirqd/023:12:030
4463993125,4cyclictest9-21ksoftirqd/023:08:140
4463993125,4cyclictest9-21ksoftirqd/021:51:200
4463993125,4cyclictest9-21ksoftirqd/020:40:430
4463993125,4cyclictest9-21ksoftirqd/020:36:180
4463993125,4cyclictest9-21ksoftirqd/019:15:130
4466993025,3cyclictest41-21ksoftirqd/320:09:363
4466993025,3cyclictest41-21ksoftirqd/319:37:493
4466993024,4cyclictest41-21ksoftirqd/319:13:343
4465993025,3cyclictest33-21ksoftirqd/200:27:562
4465993024,4cyclictest33-21ksoftirqd/221:48:332
4465993024,4cyclictest33-21ksoftirqd/219:19:372
4464993025,3cyclictest25-21ksoftirqd/120:41:081
4464993024,4cyclictest25-21ksoftirqd/121:37:261
4464993023,5cyclictest25-21ksoftirqd/121:28:031
4463993026,3cyclictest9-21ksoftirqd/020:00:230
4463993025,3cyclictest9-21ksoftirqd/023:33:220
4463993025,3cyclictest9-21ksoftirqd/021:03:360
4463993025,3cyclictest9-21ksoftirqd/019:55:580
4463993025,3cyclictest9-21ksoftirqd/019:23:010
4463993024,4cyclictest9-21ksoftirqd/023:28:240
4463993024,4cyclictest9-21ksoftirqd/021:41:130
4463993023,5cyclictest9-21ksoftirqd/000:07:120
4463993023,5cyclictest9-21ksoftirqd/000:07:120
4466992924,3cyclictest41-21ksoftirqd/322:08:243
4466992923,4cyclictest41-21ksoftirqd/323:08:263
4465992924,3cyclictest33-21ksoftirqd/223:49:182
4465992924,3cyclictest33-21ksoftirqd/223:16:012
4465992923,4cyclictest33-21ksoftirqd/221:59:092
4465992923,4cyclictest33-21ksoftirqd/219:26:442
4465992923,3cyclictest33-21ksoftirqd/200:01:382
446499299,18cyclictest29350-21cstates00:30:151
446499299,16cyclictest29167-21grep22:15:201
4464992923,4cyclictest25-21ksoftirqd/123:46:231
4464992923,4cyclictest25-21ksoftirqd/122:46:571
4464992923,4cyclictest25-21ksoftirqd/122:44:081
4464992923,4cyclictest25-21ksoftirqd/120:26:051
446499290,3cyclictest7875-21taskset20:23:321
4463992924,3cyclictest9-21ksoftirqd/021:09:000
4463992924,3cyclictest9-21ksoftirqd/019:30:540
4463992924,3cyclictest9-21ksoftirqd/019:30:540
4463992923,4cyclictest9-21ksoftirqd/023:24:350
4463992923,4cyclictest9-21ksoftirqd/022:10:380
4463992923,4cyclictest9-21ksoftirqd/000:37:490
4463992923,3cyclictest9-21ksoftirqd/019:47:050
4466992823,3cyclictest41-21ksoftirqd/322:45:193
4466992823,3cyclictest41-21ksoftirqd/320:47:503
4465992823,3cyclictest33-21ksoftirqd/223:13:242
4465992823,3cyclictest33-21ksoftirqd/222:27:342
4465992823,3cyclictest33-21ksoftirqd/222:19:542
4465992823,3cyclictest33-21ksoftirqd/220:57:252
4465992822,4cyclictest33-21ksoftirqd/223:37:052
4465992822,4cyclictest33-21ksoftirqd/222:46:272
4465992822,4cyclictest33-21ksoftirqd/220:47:522
446499288,18cyclictest15399-21cat21:45:221
4463992823,3cyclictest9-21ksoftirqd/023:20:000
4463992823,3cyclictest9-21ksoftirqd/022:16:270
4463992823,3cyclictest9-21ksoftirqd/020:22:070
4463992823,3cyclictest9-21ksoftirqd/020:05:180
4463992823,3cyclictest9-21ksoftirqd/019:54:120
4463992822,4cyclictest9-21ksoftirqd/021:46:180
4463992822,4cyclictest9-21ksoftirqd/021:22:160
4463992822,4cyclictest9-21ksoftirqd/020:30:280
4463992822,4cyclictest9-21ksoftirqd/000:11:210
4463992821,5cyclictest9-21ksoftirqd/023:51:110
4466992722,3cyclictest41-21ksoftirqd/300:08:373
4466992722,3cyclictest41-21ksoftirqd/300:08:373
4465992722,3cyclictest33-21ksoftirqd/223:56:302
4465992722,3cyclictest33-21ksoftirqd/223:29:452
4465992722,3cyclictest33-21ksoftirqd/223:02:292
4465992722,3cyclictest33-21ksoftirqd/221:16:452
4465992722,3cyclictest33-21ksoftirqd/219:53:072
4465992721,3cyclictest33-21ksoftirqd/222:07:132
446599270,14cyclictest2011-21kworker/2:219:37:462
4463992723,3cyclictest9-21ksoftirqd/022:27:280
4463992722,3cyclictest9-21ksoftirqd/022:52:360
4463992722,3cyclictest9-21ksoftirqd/021:15:220
4463992721,4cyclictest9-21ksoftirqd/022:23:450
4463992721,4cyclictest9-21ksoftirqd/022:23:450
4463992721,4cyclictest9-21ksoftirqd/020:57:370
4463992721,4cyclictest9-21ksoftirqd/019:29:430
4463992721,4cyclictest9-21ksoftirqd/000:17:350
4466992621,3cyclictest41-21ksoftirqd/323:59:283
4466992621,3cyclictest41-21ksoftirqd/323:38:363
4466992621,3cyclictest41-21ksoftirqd/321:12:063
4466992621,3cyclictest41-21ksoftirqd/300:34:023
4466992620,4cyclictest41-21ksoftirqd/319:50:083
4465992621,3cyclictest33-21ksoftirqd/221:39:542
4465992621,3cyclictest33-21ksoftirqd/220:22:092
4465992621,3cyclictest33-21ksoftirqd/219:44:042
4463992622,3cyclictest9-21ksoftirqd/022:35:000
4463992621,3cyclictest9-21ksoftirqd/023:36:440
4463992620,4cyclictest9-21ksoftirqd/021:57:230
4465992520,3cyclictest33-21ksoftirqd/221:26:302
4465992519,4cyclictest33-21ksoftirqd/221:42:312
4463992520,3cyclictest9-21ksoftirqd/021:34:390
4463992520,3cyclictest9-21ksoftirqd/020:15:000
4463992519,4cyclictest9-21ksoftirqd/020:25:470
4465992418,4cyclictest33-21ksoftirqd/219:57:092
4463992419,3cyclictest9-21ksoftirqd/020:52:260
4463992418,4cyclictest9-21ksoftirqd/023:55:190
4463992418,4cyclictest9-21ksoftirqd/023:50:000
136991240,0ptp4l401ktimersoftd/319:25:223
4466992318,3cyclictest41-21ksoftirqd/322:16:193
136991230,0ptp4l401ktimersoftd/322:35:123
136991230,0ptp4l401ktimersoftd/322:00:143
136991230,0ptp4l401ktimersoftd/321:32:173
136991230,0ptp4l401ktimersoftd/300:25:093
4463992218,3cyclictest9-21ksoftirqd/000:25:200
4465992116,3cyclictest33-21ksoftirqd/221:10:522
4465992115,4cyclictest33-21ksoftirqd/220:17:032
4465992015,3cyclictest33-21ksoftirqd/220:12:002
4463992016,3cyclictest9-21ksoftirqd/021:25:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional