You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 17:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot4.osadl.org (updated Sun May 31, 2026 12:46:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
185782226162,52sleep20-21swapper/207:07:052
187332208173,23sleep30-21swapper/307:09:053
186792205172,22sleep10-21swapper/107:08:231
186682204169,23sleep00-21swapper/007:08:150
1939121620,4sleep11910499cyclictest10:25:121
1881228262,10sleep10-21swapper/107:10:001
19104996328,8cyclictest25-21ksoftirqd/107:40:281
58502620,2sleep30-21swapper/311:00:243
56142620,2sleep10-21swapper/111:00:221
19104996231,4cyclictest25-21ksoftirqd/109:05:181
19103996234,4cyclictest9-21ksoftirqd/009:30:200
19103996231,4cyclictest9-21ksoftirqd/007:20:140
19104996131,3cyclictest25-21ksoftirqd/108:10:251
19104996127,3cyclictest25-21ksoftirqd/111:25:231
19103996132,4cyclictest9-21ksoftirqd/010:40:230
19103996125,6cyclictest9-21ksoftirqd/010:55:010
19104996029,4cyclictest25-21ksoftirqd/112:25:001
19103996029,4cyclictest9-21ksoftirqd/011:05:170
19104995929,3cyclictest25-21ksoftirqd/108:45:001
19104995927,4cyclictest25-21ksoftirqd/111:10:001
19104995924,4cyclictest25-21ksoftirqd/109:50:181
19104995923,3cyclictest25-21ksoftirqd/111:55:201
19103995926,4cyclictest9-21ksoftirqd/007:55:280
19104995828,4cyclictest25-21ksoftirqd/107:45:011
19104995827,3cyclictest25-21ksoftirqd/109:55:131
19104995827,3cyclictest25-21ksoftirqd/108:45:231
19104995826,3cyclictest25-21ksoftirqd/110:05:141
19104995823,4cyclictest25-21ksoftirqd/112:30:161
19104995818,4cyclictest25-21ksoftirqd/110:00:171
19103995830,3cyclictest9-21ksoftirqd/008:45:220
19103995825,4cyclictest9-21ksoftirqd/007:40:000
316842570,4sleep125-21ksoftirqd/110:50:111
19104995731,3cyclictest25-21ksoftirqd/108:05:271
19104995728,3cyclictest25-21ksoftirqd/109:25:191
19104995727,4cyclictest25-21ksoftirqd/112:15:121
19104995727,4cyclictest25-21ksoftirqd/112:15:121
19104995717,9cyclictest25-21ksoftirqd/107:35:141
19104995715,7cyclictest25-21ksoftirqd/107:57:431
19103995731,4cyclictest9-21ksoftirqd/009:55:260
19103995728,4cyclictest9-21ksoftirqd/007:45:140
19103995725,4cyclictest9-21ksoftirqd/009:50:200
19104995629,4cyclictest25-21ksoftirqd/110:10:131
19104995626,4cyclictest25-21ksoftirqd/107:30:131
19104995625,3cyclictest25-21ksoftirqd/107:50:121
19104995625,3cyclictest25-21ksoftirqd/107:50:121
19104995615,6cyclictest25-21ksoftirqd/108:02:571
19103995623,4cyclictest9-21ksoftirqd/011:35:250
19103995623,3cyclictest9-21ksoftirqd/008:55:180
19104995525,4cyclictest25-21ksoftirqd/111:20:221
19104995525,4cyclictest25-21ksoftirqd/108:25:271
19104995524,3cyclictest25-21ksoftirqd/108:55:141
19104995523,4cyclictest25-21ksoftirqd/109:15:121
19104995522,4cyclictest25-21ksoftirqd/110:45:221
19104995517,4cyclictest25-21ksoftirqd/111:52:321
19104995515,7cyclictest25-21ksoftirqd/108:17:211
19103995526,4cyclictest9-21ksoftirqd/011:00:220
19103995521,4cyclictest9-21ksoftirqd/011:00:010
156022550,1sleep30-21swapper/312:25:253
19104995432,2cyclictest25-21ksoftirqd/109:30:231
19104995427,2cyclictest25-21ksoftirqd/108:50:171
19104995421,4cyclictest25-21ksoftirqd/109:00:121
19104995421,4cyclictest25-21ksoftirqd/109:00:111
56152530,2sleep30-21swapper/308:50:263
19105995330,5cyclictest33-21ksoftirqd/207:55:012
19105995330,5cyclictest33-21ksoftirqd/207:55:002
19104995326,4cyclictest25-21ksoftirqd/110:15:211
19104995326,3cyclictest25-21ksoftirqd/112:05:191
19104995323,4cyclictest25-21ksoftirqd/111:45:131
19104995316,7cyclictest25-21ksoftirqd/107:28:141
19103995342,3cyclictest9-21ksoftirqd/011:15:000
19103995325,5cyclictest9-21ksoftirqd/007:15:210
19103995324,4cyclictest9-21ksoftirqd/010:25:000
19103995322,4cyclictest9-21ksoftirqd/007:30:000
19104995225,4cyclictest25-21ksoftirqd/110:40:261
19104995217,7cyclictest25-21ksoftirqd/108:22:301
19104995215,3cyclictest25-21ksoftirqd/109:12:171
19103995226,4cyclictest9-21ksoftirqd/008:10:150
19103995219,5cyclictest9-21ksoftirqd/009:25:120
19103995218,4cyclictest9-21ksoftirqd/011:55:180
19104995129,3cyclictest25-21ksoftirqd/111:30:221
1910399513,8cyclictest9-21ksoftirqd/009:45:010
19103995128,4cyclictest9-21ksoftirqd/008:35:000
19103995128,4cyclictest9-21ksoftirqd/008:35:000
19104995018,7cyclictest25-21ksoftirqd/108:35:231
19103995024,2cyclictest9-21ksoftirqd/011:50:210
19103995019,4cyclictest9-21ksoftirqd/009:00:120
19103995019,4cyclictest9-21ksoftirqd/009:00:120
19104994917,8cyclictest25-21ksoftirqd/110:22:141
19103994933,4cyclictest9-21ksoftirqd/007:40:170
19103994920,4cyclictest9-21ksoftirqd/011:40:240
19103994919,3cyclictest9-21ksoftirqd/012:05:010
1910399491,8cyclictest121rcu_preempt08:00:190
19103994918,4cyclictest9-21ksoftirqd/012:10:130
19104994819,4cyclictest25-21ksoftirqd/112:00:201
19104994818,4cyclictest25-21ksoftirqd/111:10:251
19104994815,6cyclictest25-21ksoftirqd/109:35:231
19103994819,4cyclictest9-21ksoftirqd/012:30:240
19105994741,3cyclictest62150irq/144-enp4s0-09:20:002
19105994720,18cyclictest33-21ksoftirqd/209:55:262
1910499476,9cyclictest25-21ksoftirqd/110:40:001
19104994716,7cyclictest25-21ksoftirqd/111:15:131
19104994716,7cyclictest25-21ksoftirqd/111:15:131
19104994716,3cyclictest25-21ksoftirqd/109:23:381
19103994737,3cyclictest9-21ksoftirqd/010:45:270
1910399473,2cyclictest121rcu_preempt08:10:000
19103994732,4cyclictest9-21ksoftirqd/009:35:170
19103994731,4cyclictest9-21ksoftirqd/008:15:180
19103994719,9cyclictest9-21ksoftirqd/010:05:010
19103994715,4cyclictest9-21ksoftirqd/011:20:010
19103994713,11cyclictest9-21ksoftirqd/007:30:130
1910399470,3cyclictest121rcu_preempt08:25:000
138491470,1ptp4l391rcuc/307:24:393
19104994632,4cyclictest25-21ksoftirqd/112:25:191
1910499462,2cyclictest121rcu_preempt09:40:201
19104994617,8cyclictest25-21ksoftirqd/109:45:251
19103994635,3cyclictest9-21ksoftirqd/010:30:170
19103994635,3cyclictest9-21ksoftirqd/010:10:140
19103994631,4cyclictest9-21ksoftirqd/009:15:130
19103994621,8cyclictest9-21ksoftirqd/009:10:200
19103994616,5cyclictest9-21ksoftirqd/008:25:210
1910399461,3cyclictest121rcu_preempt11:25:180
1910399460,6cyclictest121rcu_preempt11:15:260
1910399460,6cyclictest121rcu_preempt11:15:260
1910399460,3cyclictest121rcu_preempt11:30:190
1910499453,2cyclictest121rcu_preempt11:41:341
19103994534,4cyclictest9-21ksoftirqd/007:10:120
19103994534,3cyclictest9-21ksoftirqd/008:35:150
1910399451,8cyclictest9-21ksoftirqd/010:25:150
19103994515,9cyclictest9-21ksoftirqd/008:45:000
19103994514,3cyclictest9-21ksoftirqd/011:45:160
1910399450,7cyclictest121rcu_preempt08:50:270
19105994425,5cyclictest33-21ksoftirqd/210:55:002
1910499445,3cyclictest25-21ksoftirqd/111:35:191
1910499442,2cyclictest121rcu_preempt07:20:151
19103994434,3cyclictest9-21ksoftirqd/009:20:270
19103994430,4cyclictest9-21ksoftirqd/010:05:020
19103994426,10cyclictest9-21ksoftirqd/009:50:000
19103994333,3cyclictest9-21ksoftirqd/007:50:160
19103994333,3cyclictest9-21ksoftirqd/007:50:150
19103994331,3cyclictest9-21ksoftirqd/012:20:160
1910399431,6cyclictest121rcu_preempt12:05:300
1910399430,3cyclictest121rcu_preempt10:15:250
1910399430,2cyclictest121rcu_preempt12:35:280
1910499422,2cyclictest121rcu_preempt12:10:181
19103994233,3cyclictest9-21ksoftirqd/012:15:120
19103994233,3cyclictest9-21ksoftirqd/012:15:120
19103994228,2cyclictest15958-21seq12:26:260
1910399420,6cyclictest121rcu_preempt10:35:230
138491420,0ptp4l401ktimersoftd/310:30:133
19105994137,2cyclictest33-21ksoftirqd/208:40:012
19105994136,3cyclictest33-21ksoftirqd/212:40:002
19105994136,3cyclictest33-21ksoftirqd/211:20:002
19105994136,3cyclictest33-21ksoftirqd/211:20:002
1910499417,3cyclictest25-21ksoftirqd/112:35:191
1910499413,2cyclictest121rcu_preempt08:30:311
1910499413,2cyclictest121rcu_preempt08:30:301
19104994127,5cyclictest25-21ksoftirqd/110:30:161
19104994127,3cyclictest25-21ksoftirqd/110:55:541
138491410,0ptp4l401ktimersoftd/311:25:013
138491410,0ptp4l401ktimersoftd/309:35:123
138491410,0ptp4l401ktimersoftd/308:02:343
19106994025,12cyclictest41-21ksoftirqd/308:30:133
19106994025,12cyclictest41-21ksoftirqd/308:30:133
50798390,5rtkit-daemon9912-21iostat11:10:172
19105993934,3cyclictest33-21ksoftirqd/212:00:012
19105993933,4cyclictest33-21ksoftirqd/209:50:002
19105993915,15cyclictest33-21ksoftirqd/207:40:132
1910499396,3cyclictest25-21ksoftirqd/107:15:221
1910399390,2cyclictest121rcu_preempt09:05:240
19106993832,4cyclictest41-21ksoftirqd/310:43:393
19105993833,3cyclictest33-21ksoftirqd/207:35:002
19105993833,3cyclictest21250-21egrep09:25:112
19105993832,4cyclictest33-21ksoftirqd/211:02:042
19105993832,4cyclictest33-21ksoftirqd/207:48:152
19105993817,5cyclictest33-21ksoftirqd/208:10:182
19106993731,4cyclictest41-21ksoftirqd/308:28:373
19106993730,4cyclictest41-21ksoftirqd/309:56:263
19105993733,2cyclictest33-21ksoftirqd/208:24:592
19105993732,3cyclictest33-21ksoftirqd/210:50:002
19105993732,3cyclictest33-21ksoftirqd/209:40:182
19105993731,4cyclictest33-21ksoftirqd/209:24:072
19106993630,4cyclictest41-21ksoftirqd/312:00:013
19106993630,4cyclictest41-21ksoftirqd/310:11:583
19106993630,4cyclictest41-21ksoftirqd/307:26:423
19106993629,4cyclictest31243-21cron07:34:593
19105993632,3cyclictest33-21ksoftirqd/207:30:012
19105993632,2cyclictest33-21ksoftirqd/209:03:342
19105993632,2cyclictest33-21ksoftirqd/209:03:342
19105993631,3cyclictest33-21ksoftirqd/209:05:582
19105993631,3cyclictest33-21ksoftirqd/207:57:342
19105993631,3cyclictest33-21ksoftirqd/207:15:182
19105993631,2cyclictest33-21ksoftirqd/207:15:002
19105993630,4cyclictest33-21ksoftirqd/210:24:292
19105993630,3cyclictest33-21ksoftirqd/210:55:132
19105993629,4cyclictest33-21ksoftirqd/212:23:042
19105993629,4cyclictest33-21ksoftirqd/211:24:462
19105993626,9cyclictest33-21ksoftirqd/211:50:202
50798350,3rtkit-daemon20254-21mailstats09:20:263
19106993530,3cyclictest41-21ksoftirqd/310:18:523
19106993529,4cyclictest41-21ksoftirqd/310:39:543
19106993529,4cyclictest41-21ksoftirqd/307:48:053
19106993528,5cyclictest41-21ksoftirqd/310:55:323
1910699350,33cyclictest8952-21latency_hist11:10:003
19105993532,2cyclictest33-21ksoftirqd/211:07:342
19105993530,3cyclictest33-21ksoftirqd/212:15:002
19105993530,3cyclictest33-21ksoftirqd/211:47:432
19105993530,3cyclictest33-21ksoftirqd/211:40:002
19105993530,3cyclictest33-21ksoftirqd/208:45:002
19105993530,3cyclictest33-21ksoftirqd/208:20:002
19105993529,4cyclictest33-21ksoftirqd/212:28:052
19105993529,4cyclictest33-21ksoftirqd/209:35:312
19105993529,4cyclictest33-21ksoftirqd/208:54:552
19105993529,3cyclictest33-21ksoftirqd/210:05:012
19105993528,4cyclictest33-21ksoftirqd/212:30:412
19106993428,4cyclictest41-21ksoftirqd/311:48:343
19106993428,4cyclictest41-21ksoftirqd/311:30:533
19106993428,4cyclictest41-21ksoftirqd/309:11:453
19106993428,4cyclictest41-21ksoftirqd/309:03:233
19106993428,4cyclictest41-21ksoftirqd/309:03:223
19106993428,4cyclictest41-21ksoftirqd/308:35:583
19106993428,4cyclictest41-21ksoftirqd/307:52:373
19106993428,4cyclictest41-21ksoftirqd/307:52:373
19106993428,4cyclictest41-21ksoftirqd/307:41:433
19106993412,4cyclictest30929-21head11:50:263
19105993429,3cyclictest33-21ksoftirqd/210:10:002
19105993428,4cyclictest33-21ksoftirqd/212:15:492
19105993428,4cyclictest33-21ksoftirqd/212:15:492
19105993428,4cyclictest33-21ksoftirqd/211:42:522
19105993428,4cyclictest33-21ksoftirqd/208:46:522
1910599341,3cyclictest121rcu_preempt07:20:212
19106993328,3cyclictest16494-21egrep12:30:113
19106993327,4cyclictest41-21ksoftirqd/312:24:573
19106993327,4cyclictest41-21ksoftirqd/312:09:213
19106993327,4cyclictest41-21ksoftirqd/311:18:183
19106993327,4cyclictest41-21ksoftirqd/311:18:183
19106993327,4cyclictest41-21ksoftirqd/310:49:373
19106993327,4cyclictest41-21ksoftirqd/310:21:453
19106993327,4cyclictest41-21ksoftirqd/308:23:223
19106993327,4cyclictest41-21ksoftirqd/307:38:053
19106993313,17cyclictest21578-21/usr/sbin/munin07:15:143
19106993312,3cyclictest31630-21ls08:40:143
19106993311,3cyclictest24453-21seq11:40:123
19105993328,3cyclictest33-21ksoftirqd/210:40:002
19105993328,3cyclictest33-21ksoftirqd/209:53:002
19105993328,3cyclictest33-21ksoftirqd/209:12:132
19105993327,4cyclictest33-21ksoftirqd/212:07:032
19105993327,4cyclictest33-21ksoftirqd/211:29:082
19105993327,4cyclictest33-21ksoftirqd/209:33:422
19105993321,10cyclictest33-21ksoftirqd/212:00:252
19105993318,4cyclictest33-21ksoftirqd/210:40:192
19106993227,3cyclictest41-21ksoftirqd/309:16:423
19106993227,3cyclictest41-21ksoftirqd/308:19:013
19106993226,4cyclictest41-21ksoftirqd/311:35:393
19106993226,4cyclictest41-21ksoftirqd/309:49:253
19106993226,4cyclictest41-21ksoftirqd/308:56:363
19106993212,3cyclictest21366-21tr09:25:133
19105993228,3cyclictest33-21ksoftirqd/208:30:152
19105993228,3cyclictest33-21ksoftirqd/208:30:152
19105993227,3cyclictest33-21ksoftirqd/208:05:252
19105993226,4cyclictest33-21ksoftirqd/211:30:282
19105993217,5cyclictest33-21ksoftirqd/208:05:002
19106993127,3cyclictest41-21ksoftirqd/312:13:343
19106993126,3cyclictest41-21ksoftirqd/310:25:353
19106993125,4cyclictest41-21ksoftirqd/312:01:023
19106993125,4cyclictest41-21ksoftirqd/310:09:293
19106993125,3cyclictest41-21ksoftirqd/308:47:303
19106993113,16cyclictest31678-21/usr/sbin/munin10:50:273
19106993112,3cyclictest9082-21/usr/sbin/munin12:15:213
19106993112,3cyclictest9082-21/usr/sbin/munin12:15:213
19106993110,3cyclictest25311-21cat09:30:223
19105993127,2cyclictest33-21ksoftirqd/210:15:002
19105993125,3cyclictest33-21ksoftirqd/210:15:202
19105993125,3cyclictest33-21ksoftirqd/207:35:502
1910699309,3cyclictest6975-21smartctl10:00:163
19106993025,3cyclictest41-21ksoftirqd/309:05:083
19106993024,4cyclictest41-21ksoftirqd/308:14:003
19106993011,3cyclictest29027-21expr09:40:133
1910699300,28cyclictest0-21swapper/311:25:013
19105993025,3cyclictest33-21ksoftirqd/208:28:472
19105993024,4cyclictest33-21ksoftirqd/210:31:112
19105993018,10cyclictest33-21ksoftirqd/210:25:192
19106992923,4cyclictest41-21ksoftirqd/311:14:493
19106992923,4cyclictest41-21ksoftirqd/307:57:513
1910599291,6cyclictest121rcu_preempt09:00:012
19106992822,4cyclictest41-21ksoftirqd/312:36:453
138491280,1ptp4l401ktimersoftd/307:10:013
19106992722,3cyclictest41-21ksoftirqd/309:52:133
19106992722,3cyclictest41-21ksoftirqd/308:09:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional