You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 15:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Mon Jun 16, 2025 00:45:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68872204170,23sleep20-21swapper/219:09:482
68202203168,23sleep30-21swapper/319:08:563
67362201167,23sleep10-21swapper/119:07:511
66972200166,22sleep00-21swapper/019:07:200
1632521720,6sleep2719899cyclictest20:30:192
2405321640,6sleep3719999cyclictest21:50:273
719799651,21cyclictest18659-21sed23:50:231
719799648,18cyclictest4254-21switchtime22:15:221
54502640,3sleep0111rcuc/021:15:140
719799611,20cyclictest9724-21gpgconf19:15:001
719799600,22cyclictest19425-21awk21:40:281
719799600,20cyclictest17836-21/usr/sbin/munin20:35:181
719799600,18cyclictest2706-21latency_hist23:20:001
719799590,20cyclictest28732-21sed23:05:211
719799590,19cyclictest6766-21phc2sys-jitter00:30:231
719799581,20cyclictest11675-21systemctl21:25:271
719799580,22cyclictest20948-21sed19:35:211
719799580,19cyclictest12982-21cat21:30:151
162922580,2sleep00-21swapper/021:35:230
45062560,1sleep00-21swapper/000:25:280
134991540,1ptp4l401ktimersoftd/300:26:043
719799520,19cyclictest5249-21apt-get21:15:111
292202520,2sleep0719699cyclictest23:05:260
719799511,19cyclictest15784-21hddtemp_smartct23:45:211
719799501,18cyclictest26880-21python23:00:281
719799490,17cyclictest29255-21python20:55:301
719799490,17cyclictest12282-21apt-get20:25:021
719799480,19cyclictest22111-21ls22:50:321
719799480,18cyclictest227-21systemd-journal19:49:371
719799471,19cyclictest8261-21df_inode23:30:191
7198994639,4cyclictest14857-21cron21:35:002
7198994639,3cyclictest33-21ksoftirqd/219:20:012
719799461,18cyclictest9047-21memory00:35:261
719799461,15cyclictest17862-21df19:30:141
719799460,16cyclictest17052-21ls20:30:261
719699468,5cyclictest9-21ksoftirqd/020:25:000
719699468,5cyclictest9-21ksoftirqd/020:25:000
719799451,22cyclictest1621-21gnome-shell21:54:581
134991450,1ptp4l401ktimersoftd/321:49:023
719799441,16cyclictest31249-21meminfo22:05:201
7196994413,4cyclictest9-21ksoftirqd/022:55:200
7196994410,4cyclictest9-21ksoftirqd/021:25:290
7196994332,3cyclictest9-21ksoftirqd/021:25:000
7196994313,6cyclictest9-21ksoftirqd/022:10:000
134991430,0ptp4l401ktimersoftd/322:54:553
134991430,0ptp4l401ktimersoftd/320:22:303
134991430,0ptp4l401ktimersoftd/320:22:303
719999421,39cyclictest2466-21cron22:15:003
719799421,18cyclictest20833-21df_inode20:40:161
719799421,17cyclictest23363-21iostat_ios00:00:211
719799421,15cyclictest13372-21hddtemp_smartct22:35:171
719699429,3cyclictest9-21ksoftirqd/022:55:000
7196994237,3cyclictest9-21ksoftirqd/023:30:260
7198994136,3cyclictest33-21ksoftirqd/222:40:002
7198994135,3cyclictest33-21ksoftirqd/220:20:002
7198994128,3cyclictest33-21ksoftirqd/223:15:232
719899411,8cyclictest121rcu_preempt22:05:032
719799411,15cyclictest5799-21df_inode23:25:211
719799411,15cyclictest30423-21df19:55:131
719699412,7cyclictest9-21ksoftirqd/021:45:000
690424131,4sleep30-21swapper/319:10:013
134991410,0ptp4l401ktimersoftd/323:28:213
134991410,0ptp4l401ktimersoftd/322:35:293
134991410,0ptp4l401ktimersoftd/319:15:253
7199994035,3cyclictest41-21ksoftirqd/321:00:003
719899404,2cyclictest121rcu_preempt20:10:212
7198994035,2cyclictest33-21ksoftirqd/222:50:012
7198994028,9cyclictest33-21ksoftirqd/223:00:302
7198994026,11cyclictest33-21ksoftirqd/220:05:012
719799401,25cyclictest601-21df21:05:151
719799401,16cyclictest25672-21hddtemp_smartct00:05:181
719799401,16cyclictest227-21systemd-journal22:10:001
719699408,9cyclictest9-21ksoftirqd/020:45:220
719699408,4cyclictest9-21ksoftirqd/020:20:000
719699406,3cyclictest9-21ksoftirqd/020:30:140
719699406,3cyclictest9-21ksoftirqd/019:30:140
719699404,8cyclictest9-21ksoftirqd/023:05:000
719699404,6cyclictest9-21ksoftirqd/022:50:000
719699403,7cyclictest9-21ksoftirqd/019:50:230
719699403,5cyclictest9-21ksoftirqd/021:55:000
719699403,3cyclictest9-21ksoftirqd/019:20:010
7196994028,4cyclictest9-21ksoftirqd/023:55:010
134991400,0ptp4l401ktimersoftd/323:35:593
7198993935,2cyclictest33-21ksoftirqd/200:20:002
7198993933,3cyclictest33-21ksoftirqd/200:25:002
719799391,17cyclictest5824-21iostat20:10:171
719799391,16cyclictest28059-21df_inode19:50:141
719799391,15cyclictest20549-21df_inode21:45:151
719699396,4cyclictest9-21ksoftirqd/021:00:150
719699395,3cyclictest9-21ksoftirqd/000:20:180
7196993934,3cyclictest9-21ksoftirqd/022:25:010
7196993934,3cyclictest9-21ksoftirqd/020:05:010
7196993910,6cyclictest9-21ksoftirqd/021:45:240
7198993833,3cyclictest33-21ksoftirqd/222:20:002
719799381,15cyclictest3608-21hddtemp_smartct00:25:221
719699387,9cyclictest9-21ksoftirqd/019:45:000
719699386,3cyclictest9-21ksoftirqd/023:45:230
719699386,3cyclictest9-21ksoftirqd/022:10:220
719699385,4cyclictest9-21ksoftirqd/020:10:010
719699385,3cyclictest9-21ksoftirqd/023:40:310
719699385,3cyclictest9-21ksoftirqd/022:45:000
7196993833,3cyclictest9-21ksoftirqd/023:10:280
134991380,0ptp4l401ktimersoftd/322:45:143
7198993732,3cyclictest33-21ksoftirqd/200:05:002
7198993727,9cyclictest33-21ksoftirqd/200:31:402
7198993725,9cyclictest33-21ksoftirqd/220:40:152
7198993721,4cyclictest33-21ksoftirqd/222:30:292
719699379,4cyclictest9-21ksoftirqd/020:50:200
719699378,4cyclictest9-21ksoftirqd/020:35:290
719699377,6cyclictest9-21ksoftirqd/022:25:140
719699377,3cyclictest9-21ksoftirqd/023:15:170
719699376,4cyclictest9-21ksoftirqd/022:30:220
719699376,2cyclictest9-21ksoftirqd/020:40:150
7196993731,3cyclictest9-21ksoftirqd/022:40:000
7196993723,3cyclictest9-21ksoftirqd/020:55:270
719699371,5cyclictest9-21ksoftirqd/022:15:110
7196993712,4cyclictest9-21ksoftirqd/000:30:130
719699371,10cyclictest9-21ksoftirqd/021:30:140
7196993710,7cyclictest9-21ksoftirqd/023:25:340
36998370,3rtkit-daemon13446-21iostat20:25:200
7199993631,3cyclictest41-21ksoftirqd/319:56:283
7199993630,4cyclictest41-21ksoftirqd/322:31:273
7199993630,4cyclictest41-21ksoftirqd/322:01:513
7199993630,4cyclictest41-21ksoftirqd/300:37:443
7199993629,4cyclictest41-21ksoftirqd/322:25:413
7199993629,4cyclictest41-21ksoftirqd/320:04:283
7198993631,3cyclictest33-21ksoftirqd/222:20:142
7198993630,4cyclictest33-21ksoftirqd/219:58:382
719799361,24cyclictest23205-21df20:45:211
719799361,17cyclictest25869-21hddtemp_smartct20:50:181
719699367,4cyclictest9-21ksoftirqd/021:10:240
719699366,4cyclictest9-21ksoftirqd/019:55:130
719699365,6cyclictest9-21ksoftirqd/023:35:210
719699364,3cyclictest121rcu_preempt23:20:310
719699364,11cyclictest9-21ksoftirqd/022:00:150
7196993632,2cyclictest9-21ksoftirqd/022:00:000
7196993632,2cyclictest9-21ksoftirqd/000:40:000
7196993631,3cyclictest9-21ksoftirqd/019:45:000
7196993631,3cyclictest9-21ksoftirqd/000:20:000
719699361,7cyclictest9-21ksoftirqd/023:55:170
719699361,5cyclictest9-21ksoftirqd/020:10:140
36998360,2rtkit-daemon0-21swapper/119:20:231
7199993529,4cyclictest41-21ksoftirqd/323:24:353
7199993529,4cyclictest41-21ksoftirqd/322:15:303
7199993529,4cyclictest41-21ksoftirqd/320:46:213
7199993529,4cyclictest41-21ksoftirqd/319:47:243
7199993529,4cyclictest41-21ksoftirqd/319:34:123
7199993528,4cyclictest41-21ksoftirqd/323:33:093
7199993528,4cyclictest41-21ksoftirqd/322:44:393
7199993528,4cyclictest41-21ksoftirqd/320:53:063
7199993528,4cyclictest41-21ksoftirqd/320:37:093
719999350,2cyclictest0-21swapper/323:41:073
719999350,2cyclictest0-21swapper/321:36:263
7198993531,3cyclictest33-21ksoftirqd/221:25:202
7198993530,3cyclictest33-21ksoftirqd/221:00:002
7198993530,3cyclictest33-21ksoftirqd/220:20:142
7198993530,3cyclictest33-21ksoftirqd/220:20:142
7198993529,4cyclictest33-21ksoftirqd/221:59:582
7198993529,4cyclictest33-21ksoftirqd/221:47:532
7198993529,4cyclictest33-21ksoftirqd/221:10:352
7198993529,4cyclictest33-21ksoftirqd/219:41:202
7198993529,4cyclictest33-21ksoftirqd/219:36:192
7198993523,10cyclictest33-21ksoftirqd/221:40:002
7198993516,11cyclictest33-21ksoftirqd/223:05:222
7197993530,3cyclictest25-21ksoftirqd/122:25:001
7197993529,4cyclictest25-21ksoftirqd/119:26:311
719699355,4cyclictest9-21ksoftirqd/019:35:140
7196993531,3cyclictest9-21ksoftirqd/000:10:170
7196993529,3cyclictest9-21ksoftirqd/000:09:510
719699352,7cyclictest9-21ksoftirqd/019:10:200
7196993520,4cyclictest9-21ksoftirqd/000:05:000
7199993429,3cyclictest41-21ksoftirqd/321:14:523
7199993429,3cyclictest41-21ksoftirqd/320:33:363
7199993428,3cyclictest41-21ksoftirqd/300:30:133
7199993427,4cyclictest41-21ksoftirqd/319:20:113
7198993430,3cyclictest33-21ksoftirqd/220:35:202
7198993429,3cyclictest33-21ksoftirqd/223:55:222
7198993429,3cyclictest33-21ksoftirqd/223:30:182
7198993429,3cyclictest33-21ksoftirqd/222:50:012
7198993429,3cyclictest33-21ksoftirqd/222:42:492
7198993429,3cyclictest33-21ksoftirqd/200:10:182
7198993428,4cyclictest33-21ksoftirqd/222:14:332
7198993428,4cyclictest33-21ksoftirqd/219:27:572
7198993428,3cyclictest33-21ksoftirqd/220:30:012
7198993427,4cyclictest33-21ksoftirqd/221:54:192
7198993427,4cyclictest33-21ksoftirqd/221:05:462
7198993427,4cyclictest33-21ksoftirqd/220:06:152
7198993423,9cyclictest33-21ksoftirqd/220:45:302
7198993410,17cyclictest33-21ksoftirqd/221:20:202
7197993429,3cyclictest25-21ksoftirqd/122:02:301
7197993428,4cyclictest25-21ksoftirqd/123:36:001
7197993428,4cyclictest25-21ksoftirqd/120:08:031
7196993429,3cyclictest9-21ksoftirqd/021:05:020
7196993429,3cyclictest9-21ksoftirqd/019:20:150
719699342,3cyclictest121rcu_preempt19:25:210
7199993328,3cyclictest41-21ksoftirqd/322:55:583
7199993327,4cyclictest41-21ksoftirqd/323:46:213
7199993327,4cyclictest41-21ksoftirqd/323:14:323
7199993327,4cyclictest41-21ksoftirqd/321:33:503
7199993327,4cyclictest41-21ksoftirqd/321:17:533
7199993326,4cyclictest41-21ksoftirqd/323:03:203
7199993326,4cyclictest41-21ksoftirqd/319:44:193
7198993329,3cyclictest33-21ksoftirqd/219:15:002
7198993328,3cyclictest33-21ksoftirqd/223:45:162
7198993328,3cyclictest33-21ksoftirqd/222:25:122
7198993328,3cyclictest33-21ksoftirqd/220:50:152
7198993327,4cyclictest33-21ksoftirqd/223:37:532
7198993327,4cyclictest33-21ksoftirqd/219:53:482
7198993327,4cyclictest33-21ksoftirqd/219:31:132
7198993327,3cyclictest33-21ksoftirqd/223:45:002
7198993311,13cyclictest33-21ksoftirqd/221:15:112
7197993327,4cyclictest25-21ksoftirqd/122:30:101
7197993327,4cyclictest25-21ksoftirqd/121:39:301
7197993327,4cyclictest25-21ksoftirqd/100:11:341
719799331,17cyclictest3251-21df23:20:211
719799330,20cyclictest7934-21cstates21:20:131
134991330,0ptp4l401ktimersoftd/322:06:033
7199993227,3cyclictest41-21ksoftirqd/323:15:573
7199993227,3cyclictest41-21ksoftirqd/320:18:573
7199993226,4cyclictest41-21ksoftirqd/322:22:323
7199993226,4cyclictest41-21ksoftirqd/320:40:503
7199993226,4cyclictest41-21ksoftirqd/300:20:553
7199993226,4cyclictest41-21ksoftirqd/300:18:103
7199993226,3cyclictest41-21ksoftirqd/300:10:583
7199993225,4cyclictest41-21ksoftirqd/321:02:013
7199993225,4cyclictest41-21ksoftirqd/320:05:123
719899323,3cyclictest121rcu_preempt23:00:012
7198993228,3cyclictest33-21ksoftirqd/223:25:252
7198993226,4cyclictest33-21ksoftirqd/219:23:162
7198993225,4cyclictest33-21ksoftirqd/223:23:532
719899321,3cyclictest121rcu_preempt00:05:282
719799322,29cyclictest22012-21kworker/1:100:15:581
719799321,17cyclictest0-21swapper/120:15:151
7199993126,3cyclictest41-21ksoftirqd/319:36:303
7199993125,4cyclictest41-21ksoftirqd/323:08:063
7199993125,4cyclictest41-21ksoftirqd/321:24:513
7199993125,3cyclictest41-21ksoftirqd/320:25:583
7199993124,4cyclictest41-21ksoftirqd/321:25:123
7198993126,3cyclictest33-21ksoftirqd/223:10:132
7198993126,3cyclictest33-21ksoftirqd/200:25:172
7198993125,4cyclictest33-21ksoftirqd/221:04:412
7198993125,3cyclictest33-21ksoftirqd/223:50:282
7198993125,3cyclictest33-21ksoftirqd/222:01:472
7197993125,4cyclictest25-21ksoftirqd/122:58:091
719799311,17cyclictest1621-21gnome-shell22:47:581
719799311,17cyclictest1621-21gnome-shell22:25:581
134991310,10ptp4l401ktimersoftd/323:55:283
7198993026,3cyclictest33-21ksoftirqd/219:45:142
7198993023,3cyclictest33-21ksoftirqd/200:40:002
7197993025,3cyclictest25-21ksoftirqd/121:04:101
719799300,16cyclictest0-21swapper/121:10:161
134991300,8ptp4l401ktimersoftd/319:28:493
134991300,0ptp4l401ktimersoftd/321:57:343
7199992923,4cyclictest41-21ksoftirqd/321:40:113
7198992923,4cyclictest33-21ksoftirqd/221:37:422
7197992923,4cyclictest25-21ksoftirqd/123:58:061
7197992910,16cyclictest1786-21date20:00:261
719799290,17cyclictest0-21swapper/119:10:141
134991290,0ptp4l401ktimersoftd/323:51:373
134991290,0ptp4l401ktimersoftd/320:10:593
134991290,0ptp4l401ktimersoftd/300:07:363
7199992822,4cyclictest2548-21latency_hist21:09:593
7197992822,4cyclictest25-21ksoftirqd/119:44:011
7197992811,15cyclictest16684-21rt-features22:40:241
134991280,0ptp4l401ktimersoftd/300:01:393
7199992722,3cyclictest41-21ksoftirqd/319:54:223
719799272,21cyclictest10100-21cpu20:20:141
719799272,21cyclictest10100-21cpu20:20:131
7197992721,4cyclictest25-21ksoftirqd/100:20:451
7197992620,4cyclictest25-21ksoftirqd/123:14:301
7197992518,4cyclictest25-21ksoftirqd/121:55:061
719799250,22cyclictest13754-21sed23:40:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional