You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot1.osadl.org (updated Mon May 05, 2025 00:45:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164621550,6sleep01202699cyclictest00:35:130
3171821530,5sleep10-21swapper/119:50:211
2759521440,7sleep21202899cyclictest22:00:282
12026996823,7cyclictest9-21ksoftirqd/022:00:170
12028996516,15cyclictest18730-21seq22:51:042
12028996516,15cyclictest18730-21seq22:51:042
12028996515,15cyclictest1299-21runrttasks20:18:282
12028996513,10cyclictest28887-21chrt00:25:022
12028996512,16cyclictest8802-21needreboot22:30:222
12028996413,15cyclictest24815-21ls19:35:232
12028996313,16cyclictest14360-21chrt21:33:402
12028996312,12cyclictest19088-21taskset00:03:142
12028996312,11cyclictest3196-21apt-get21:10:122
12028996216,16cyclictest16576-21runrttasks23:55:432
12028996215,17cyclictest14312-21seq22:43:222
12028996213,11cyclictest3151-21chrt22:20:052
12028996213,11cyclictest3151-21chrt22:20:052
12026996229,5cyclictest9-21ksoftirqd/021:30:000
12028996116,12cyclictest23534-21seq23:00:432
12026996126,6cyclictest9-21ksoftirqd/023:55:180
2847191600,3ptp4l0-21swapper/120:29:581
12028996016,18cyclictest5119-21runrttasks23:31:322
12028996015,10cyclictest12072-21runrttasks21:28:482
12028995913,9cyclictest19543-21df21:45:142
12028995912,9cyclictest14231-21cat19:15:002
12026995926,5cyclictest9-21ksoftirqd/023:25:280
2847191580,4ptp4l0-21swapper/023:35:250
12028995815,16cyclictest30397-21runrttasks22:06:432
12028995815,15cyclictest9364-21seq20:11:062
12028995814,16cyclictest3533-21sed00:40:012
12028995810,11cyclictest31259-21apt-config00:30:012
12026995827,5cyclictest9-21ksoftirqd/020:15:000
12026995827,4cyclictest9-21ksoftirqd/019:35:010
12026995826,4cyclictest9-21ksoftirqd/023:50:240
12026995825,6cyclictest9-21ksoftirqd/023:45:000
12026995824,5cyclictest9-21ksoftirqd/021:10:000
12026995824,5cyclictest9-21ksoftirqd/000:35:000
12026995824,4cyclictest9-21ksoftirqd/019:20:230
2847191570,15ptp4l10269-21iostat_ios19:05:191
12028995710,18cyclictest27921-21timerandwakeup23:10:282
12028995710,10cyclictest5290-21latency_hist20:05:002
1202899570,12cyclictest2823-21awk20:00:002
12026995726,5cyclictest9-21ksoftirqd/022:10:210
12026995725,5cyclictest9-21ksoftirqd/022:50:200
12026995725,5cyclictest9-21ksoftirqd/022:50:200
12026995725,5cyclictest9-21ksoftirqd/022:35:310
12026995724,5cyclictest9-21ksoftirqd/021:40:170
12026995723,4cyclictest9-21ksoftirqd/020:05:220
1202899563,17cyclictest0-21swapper/221:00:372
12028995615,18cyclictest9926-21seq23:44:002
12028995611,16cyclictest18213-21phc2sys21:40:282
12026995627,5cyclictest9-21ksoftirqd/019:45:190
12026995626,4cyclictest9-21ksoftirqd/000:20:180
12026995625,5cyclictest9-21ksoftirqd/023:15:150
12026995624,4cyclictest9-21ksoftirqd/022:20:280
12026995624,4cyclictest9-21ksoftirqd/022:20:280
12026995623,5cyclictest9-21ksoftirqd/020:25:230
2847191550,4ptp4l0-21swapper/121:16:321
2847191550,4ptp4l0-21swapper/021:34:530
2847191550,3ptp4l0-21swapper/000:19:070
12028995518,10cyclictest25736-21runrttasks20:49:082
12028995516,12cyclictest32625-21taskset22:10:512
12028995513,17cyclictest19757-21df_abs22:55:192
12028995513,15cyclictest26576-21cat00:20:002
1202899551,18cyclictest0-21swapper/220:59:012
12026995526,5cyclictest9-21ksoftirqd/022:05:190
12026995526,5cyclictest9-21ksoftirqd/000:25:230
12026995525,4cyclictest9-21ksoftirqd/022:45:310
12026995524,5cyclictest9-21ksoftirqd/021:15:190
12026995523,5cyclictest9-21ksoftirqd/019:15:200
12026995523,5cyclictest9-21ksoftirqd/019:15:200
12026995522,5cyclictest9-21ksoftirqd/020:55:290
12026995512,2cyclictest30939-21cpuspeed_turbos19:50:140
1202899542,21cyclictest0-21swapper/223:49:222
12028995418,10cyclictest30352-21chrt19:48:022
12028995417,11cyclictest25941-21taskset21:59:352
12028995416,11cyclictest14128-21taskset20:22:512
12028995415,12cyclictest23225-21chrt19:31:012
12028995415,10cyclictest26108-21chrt23:09:162
12026995426,5cyclictest9-21ksoftirqd/021:20:240
12026995426,4cyclictest9-21ksoftirqd/020:35:210
12026995423,5cyclictest9-21ksoftirqd/020:40:220
2847191530,4ptp4l0-21swapper/120:44:581
12028995316,11cyclictest28130-21chrt20:52:322
12028995315,9cyclictest1299-21runrttasks21:21:462
12028995315,10cyclictest7216-21taskset21:15:502
12028995315,10cyclictest21194-21chrt00:05:442
12028995314,10cyclictest7249-21taskset20:08:272
12028995314,10cyclictest2683-21runrttasks21:06:382
1202899531,18cyclictest0-21swapper/221:35:312
12026995325,6cyclictest9-21ksoftirqd/019:25:300
12026995322,5cyclictest9-21ksoftirqd/023:20:300
12026995320,5cyclictest9-21ksoftirqd/022:00:000
2847191520,4ptp4l0-21swapper/323:29:313
2847191520,3ptp4l0-21swapper/119:29:201
12028995215,10cyclictest30554-21chrt23:16:342
12028995215,10cyclictest23396-21taskset20:43:322
12028995212,11cyclictest1299-21runrttasks22:19:522
12026995226,7cyclictest9-21ksoftirqd/023:30:160
12026995225,5cyclictest9-21ksoftirqd/021:45:280
12026995223,7cyclictest9-21ksoftirqd/021:00:330
12026995221,5cyclictest9-21ksoftirqd/020:15:310
12026995220,5cyclictest9-21ksoftirqd/020:30:320
12026995219,7cyclictest9-21ksoftirqd/022:40:250
12026995218,7cyclictest9-21ksoftirqd/020:00:240
12026995218,5cyclictest9-21ksoftirqd/021:10:240
2849491510,12getstats0-21swapper/323:51:063
2847191510,3ptp4l12315-21latency_hist23:49:590
2847191510,3ptp4l0-21swapper/000:10:260
1202899512,17cyclictest0-21swapper/200:12:512
12028995117,11cyclictest32573-21runrttasks19:52:032
12028995116,11cyclictest23453-21chrt21:52:092
12028995115,11cyclictest5446-21taskset22:25:032
1202899510,16cyclictest14893-21fschecks_count20:25:202
12026995122,5cyclictest9-21ksoftirqd/021:50:300
12026995118,5cyclictest9-21ksoftirqd/023:05:160
12026995117,5cyclictest9-21ksoftirqd/020:50:000
2847191500,5ptp4l0-21swapper/319:06:483
2847191500,4ptp4l0-21swapper/120:48:111
2847191500,3ptp4l0-21swapper/119:18:491
2847191500,3ptp4l0-21swapper/119:18:491
2847191500,10ptp4l10008-21diskstats19:05:150
12028995018,29cyclictest14351-21chrt23:51:402
12028995018,10cyclictest2806-21chrt23:26:162
12028995015,11cyclictest16304-21chrt19:18:412
12028995015,11cyclictest16304-21chrt19:18:412
1202699505,9cyclictest9-21ksoftirqd/021:35:290
2847191490,4ptp4l0-21swapper/122:27:451
2847191490,14ptp4l0-21swapper/322:05:473
2847191490,14ptp4l0-21swapper/319:50:553
1202899493,10cyclictest0-21swapper/219:20:242
12028994918,10cyclictest28050-21taskset19:43:442
12028994915,11cyclictest21053-21chrt20:38:172
1202899490,11cyclictest21136-21chrt19:28:452
1202699494,7cyclictest9-21ksoftirqd/019:10:150
12026994919,5cyclictest9-21ksoftirqd/022:30:270
2847191480,5ptp4l0-21swapper/219:05:362
2847191480,4ptp4l0-21swapper/022:58:570
2847191480,12ptp4l0-21swapper/321:39:253
1202899484,16cyclictest0-21swapper/220:32:142
12028994815,11cyclictest12070-21taskset22:39:222
1202899480,11cyclictest528-21taskset23:22:462
1202899480,11cyclictest15223-21awk22:45:222
1202699482,5cyclictest9-21ksoftirqd/019:45:010
12026994822,6cyclictest9-21ksoftirqd/023:10:260
12026994820,5cyclictest9-21ksoftirqd/020:45:290
12026994811,3cyclictest9-21ksoftirqd/023:00:280
2847191470,13ptp4l0-21swapper/321:40:183
1202699475,5cyclictest20510-21cat00:05:270
1202699474,4cyclictest0-21swapper/020:20:290
12026994719,5cyclictest9-21ksoftirqd/019:40:010
12026994715,5cyclictest9-21ksoftirqd/000:00:260
2847191460,12ptp4l0-21swapper/322:00:513
12028994615,7cyclictest28189-21ls00:20:292
1202899461,11cyclictest0-21swapper/223:35:172
2847191450,3ptp4l0-21swapper/121:45:251
1202699456,5cyclictest6260-21sed22:25:190
1202699453,9cyclictest9-21ksoftirqd/019:55:220
1202699450,5cyclictest28161-21apache222:15:200
2847191440,9ptp4l0-21swapper/300:08:203
2847191440,4ptp4l0-21swapper/122:36:001
2847191440,4ptp4l0-21swapper/119:33:021
2847191440,4ptp4l0-21swapper/100:13:121
2847191440,3ptp4l0-21swapper/123:30:161
1202999448,4cyclictest41-21ksoftirqd/300:35:273
2847191430,9ptp4l0-21swapper/321:18:173
2847191430,6ptp4l0-21swapper/320:50:023
2847191430,3ptp4l0-21swapper/123:08:281
1202999435,3cyclictest121rcu_preempt21:55:283
1202999434,8cyclictest41-21ksoftirqd/319:20:003
1202999434,8cyclictest41-21ksoftirqd/319:20:003
2847191420,9ptp4l0-21swapper/321:51:413
2847191420,5ptp4l31953-21irqstats23:20:211
2847191420,5ptp4l13276-21ps19:10:263
2847191420,5ptp4l0-21swapper/323:00:213
2847191420,4ptp4l29319-21irqstats19:45:211
2847191420,4ptp4l0-21swapper/300:28:473
2847191420,3ptp4l25-21ksoftirqd/100:00:191
2847191420,3ptp4l0-21swapper/320:07:283
12029994210,6cyclictest41-21ksoftirqd/300:25:003
2847191410,5ptp4l0-21swapper/322:10:263
2847191410,5ptp4l0-21swapper/321:05:163
2847191410,5ptp4l0-21swapper/320:55:173
2847191410,5ptp4l0-21swapper/121:20:201
2847191410,4ptp4l9926-21apt-get20:15:171
2847191410,4ptp4l7771-21apt-get22:30:131
2847191410,4ptp4l24292-21apt-get00:15:131
2847191410,4ptp4l13275-21irqstats21:30:221
2847191410,4ptp4l0-21swapper/321:24:293
2847191410,4ptp4l0-21swapper/319:35:163
2847191410,4ptp4l0-21swapper/123:45:291
2847191410,3ptp4l9537-21ls23:40:273
2847191410,3ptp4l827-21apt-get21:05:131
2847191410,3ptp4l0-21swapper/323:30:523
12029994128,3cyclictest41-21ksoftirqd/322:25:283
12029994113,3cyclictest41-21ksoftirqd/322:59:243
2847191400,5ptp4l0-21swapper/320:25:273
2847191400,5ptp4l0-21swapper/300:15:183
2847191400,5ptp4l0-21swapper/123:55:221
2847191400,5ptp4l0-21swapper/123:00:241
2847191400,5ptp4l0-21swapper/119:20:181
2847191400,5ptp4l0-21swapper/100:35:171
2847191400,4ptp4l30106-21/usr/sbin/munin20:55:311
2847191400,4ptp4l19406-21apt-config22:55:011
2847191400,4ptp4l0-21swapper/323:38:193
2847191400,4ptp4l0-21swapper/322:38:193
2847191400,4ptp4l0-21swapper/321:45:533
2847191400,4ptp4l0-21swapper/321:25:543
2847191400,4ptp4l0-21swapper/320:36:303
2847191400,4ptp4l0-21swapper/319:29:353
2847191400,4ptp4l0-21swapper/123:44:131
2847191400,4ptp4l0-21swapper/123:16:091
2847191400,4ptp4l0-21swapper/121:50:211
2847191400,4ptp4l0-21swapper/121:40:241
2847191400,4ptp4l0-21swapper/121:10:171
2847191400,4ptp4l0-21swapper/120:33:581
2847191400,4ptp4l0-21swapper/120:10:271
2847191400,4ptp4l0-21swapper/100:30:171
2847191400,4ptp4l0-21swapper/100:25:141
2847191400,3ptp4l26106-21apt-get19:40:121
2847191400,3ptp4l0-21swapper/322:48:413
1202999400,2cyclictest121rcu_preempt23:05:243
41798390,3rtkit-daemon0-21swapper/323:55:223
2847191390,5ptp4l0-21swapper/122:45:171
2847191390,5ptp4l0-21swapper/120:20:321
2847191390,4ptp4l0-21swapper/323:48:323
2847191390,4ptp4l0-21swapper/323:19:163
2847191390,4ptp4l0-21swapper/322:31:023
2847191390,4ptp4l0-21swapper/322:24:163
2847191390,4ptp4l0-21swapper/322:24:153
2847191390,4ptp4l0-21swapper/322:16:553
2847191390,4ptp4l0-21swapper/320:15:023
2847191390,4ptp4l0-21swapper/320:10:223
2847191390,4ptp4l0-21swapper/319:42:013
2847191390,4ptp4l0-21swapper/319:22:123
2847191390,4ptp4l0-21swapper/300:33:113
2847191390,4ptp4l0-21swapper/300:01:423
2847191390,4ptp4l0-21swapper/123:50:171
2847191390,4ptp4l0-21swapper/123:28:201
2847191390,4ptp4l0-21swapper/123:10:171
2847191390,4ptp4l0-21swapper/122:20:231
2847191390,4ptp4l0-21swapper/122:20:231
2847191390,4ptp4l0-21swapper/122:10:311
2847191390,4ptp4l0-21swapper/122:05:191
2847191390,4ptp4l0-21swapper/121:55:291
2847191390,4ptp4l0-21swapper/121:00:211
2847191390,4ptp4l0-21swapper/120:51:481
2847191390,4ptp4l0-21swapper/120:07:391
2847191390,4ptp4l0-21swapper/120:01:491
2847191390,4ptp4l0-21swapper/119:12:471
2847191390,3ptp4l2367-21ls22:15:301
2847191390,3ptp4l0-21swapper/320:43:423
2847191390,3ptp4l0-21swapper/121:29:581
2847191390,3ptp4l0-21swapper/120:35:161
2847191390,3ptp4l0-21swapper/100:10:011
1202999397,3cyclictest41-21ksoftirqd/321:10:263
1202999395,8cyclictest41-21ksoftirqd/323:15:003
2847191380,4ptp4l1913-21proc_pri19:55:251
2847191380,4ptp4l0-21swapper/320:32:443
2847191380,4ptp4l0-21swapper/320:04:563
2847191380,4ptp4l0-21swapper/319:57:183
2847191380,4ptp4l0-21swapper/319:46:093
2847191380,4ptp4l0-21swapper/319:30:013
2847191380,4ptp4l0-21swapper/123:35:221
2847191380,4ptp4l0-21swapper/122:50:161
2847191380,4ptp4l0-21swapper/122:50:161
2847191380,4ptp4l0-21swapper/100:20:151
2847191380,3ptp4l0-21swapper/323:20:103
2847191380,3ptp4l0-21swapper/119:35:241
1202999388,3cyclictest41-21ksoftirqd/322:40:263
1202999384,9cyclictest41-21ksoftirqd/320:20:173
1202999381,6cyclictest121rcu_preempt21:00:253
1202799380,27cyclictest2849691phc2sys22:40:141
2847191370,4ptp4l0-21swapper/321:32:143
2847191370,4ptp4l0-21swapper/320:48:263
2847191370,3ptp4l0-21swapper/322:50:273
2847191370,3ptp4l0-21swapper/322:50:273
2847191370,3ptp4l0-21swapper/300:12:353
2847191370,3ptp4l0-21swapper/121:35:181
1202799372,28cyclictest26250-21apt-get22:00:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional