You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 08:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Wed Nov 26, 2025 00:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137191207172,24phc2sys0-21swapper/319:09:433
266662206173,22sleep20-21swapper/219:09:232
265012203170,22sleep10-21swapper/119:07:131
245862201168,22sleep00-21swapper/019:05:100
2840121500,7sleep12701099cyclictest19:10:251
599521450,6sleep32701299cyclictest20:40:133
1371918663,15phc2sys0-21swapper/319:10:003
27011996533,4cyclictest33-21ksoftirqd/220:45:002
2701099641,61cyclictest21096-21kworker/1:222:35:471
27012996328,4cyclictest41-21ksoftirqd/300:06:013
27011996332,3cyclictest33-21ksoftirqd/222:15:002
27011996328,4cyclictest33-21ksoftirqd/223:20:002
27012996123,15cyclictest41-21ksoftirqd/320:09:593
27011996125,7cyclictest33-21ksoftirqd/219:19:102
27012996026,4cyclictest41-21ksoftirqd/320:10:183
27011996019,4cyclictest33-21ksoftirqd/223:45:192
27012995927,8cyclictest41-21ksoftirqd/320:45:153
27012995927,8cyclictest41-21ksoftirqd/320:45:153
27012995926,6cyclictest41-21ksoftirqd/320:20:223
27011995929,12cyclictest33-21ksoftirqd/222:15:122
27011995921,9cyclictest33-21ksoftirqd/222:40:232
27012995833,3cyclictest24372-21wc00:40:003
27012995828,4cyclictest41-21ksoftirqd/320:35:223
27011995830,4cyclictest33-21ksoftirqd/223:05:192
27011995828,4cyclictest33-21ksoftirqd/219:25:182
27011995827,4cyclictest33-21ksoftirqd/219:58:272
27011995825,3cyclictest33-21ksoftirqd/220:00:222
27011995820,10cyclictest33-21ksoftirqd/220:15:272
27011995820,10cyclictest33-21ksoftirqd/220:15:272
135942580,2sleep00-21swapper/023:10:130
27011995726,5cyclictest33-21ksoftirqd/223:00:142
27011995726,4cyclictest33-21ksoftirqd/222:05:262
27011995726,4cyclictest33-21ksoftirqd/219:48:242
270472560,2sleep20-21swapper/219:10:152
27012995630,3cyclictest41-21ksoftirqd/319:35:283
27012995628,4cyclictest41-21ksoftirqd/322:50:213
27012995626,6cyclictest41-21ksoftirqd/321:35:173
27012995625,7cyclictest41-21ksoftirqd/323:40:173
27012995625,4cyclictest41-21ksoftirqd/323:50:203
27012995625,4cyclictest41-21ksoftirqd/322:05:203
27012995624,7cyclictest41-21ksoftirqd/322:35:143
27011995630,4cyclictest33-21ksoftirqd/220:20:182
27011995628,4cyclictest33-21ksoftirqd/221:00:082
27011995625,3cyclictest33-21ksoftirqd/223:40:232
27011995622,4cyclictest33-21ksoftirqd/221:20:222
136991560,1ptp4l401ktimersoftd/321:59:413
27012995525,5cyclictest41-21ksoftirqd/322:40:263
27012995523,4cyclictest41-21ksoftirqd/321:45:163
27011995525,4cyclictest33-21ksoftirqd/223:55:142
27012995424,4cyclictest41-21ksoftirqd/319:20:203
27012995424,4cyclictest41-21ksoftirqd/319:20:203
27012995423,7cyclictest41-21ksoftirqd/323:45:193
27012995422,4cyclictest41-21ksoftirqd/321:25:233
27012995422,4cyclictest41-21ksoftirqd/321:10:183
27012995419,3cyclictest41-21ksoftirqd/322:10:273
27012995418,3cyclictest41-21ksoftirqd/323:00:163
27011995424,4cyclictest33-21ksoftirqd/219:33:522
27011995422,4cyclictest33-21ksoftirqd/222:00:222
27011995420,5cyclictest33-21ksoftirqd/220:50:152
27011995420,4cyclictest33-21ksoftirqd/200:39:592
2700999542,7cyclictest101ktimersoftd/020:20:000
2700999542,7cyclictest101ktimersoftd/020:20:000
27012995327,3cyclictest41-21ksoftirqd/320:55:263
27012995325,4cyclictest41-21ksoftirqd/300:00:283
27012995324,4cyclictest41-21ksoftirqd/321:16:053
27012995323,8cyclictest41-21ksoftirqd/320:30:203
27012995322,4cyclictest41-21ksoftirqd/319:15:133
27011995323,4cyclictest33-21ksoftirqd/223:50:132
27011995323,4cyclictest33-21ksoftirqd/221:35:272
27011995319,5cyclictest33-21ksoftirqd/220:45:182
27011995319,5cyclictest33-21ksoftirqd/220:45:172
27012995222,6cyclictest41-21ksoftirqd/323:55:263
27012995222,4cyclictest41-21ksoftirqd/322:00:143
27012995221,4cyclictest41-21ksoftirqd/321:30:283
27012995221,4cyclictest41-21ksoftirqd/320:29:233
27012995221,4cyclictest41-21ksoftirqd/300:25:173
27012995218,7cyclictest41-21ksoftirqd/319:40:123
27011995223,4cyclictest33-21ksoftirqd/220:35:272
27011995222,3cyclictest33-21ksoftirqd/220:30:002
27011995218,4cyclictest33-21ksoftirqd/223:10:322
2700999524,6cyclictest30965-21dpkg20:25:020
2700999522,6cyclictest7733-21grep00:05:140
2700999522,5cyclictest32008-21grep22:40:200
2700999521,5cyclictest22234-21sh22:20:190
2700999520,49cyclictest101ktimersoftd/019:15:180
2701299513,8cyclictest41-21ksoftirqd/323:20:293
27012995123,4cyclictest41-21ksoftirqd/322:15:203
27012995122,3cyclictest41-21ksoftirqd/300:30:173
27012995121,4cyclictest41-21ksoftirqd/321:50:153
27012995121,4cyclictest41-21ksoftirqd/319:25:283
27012995121,4cyclictest41-21ksoftirqd/300:20:273
27012995120,4cyclictest41-21ksoftirqd/323:15:173
27012995120,4cyclictest41-21ksoftirqd/319:30:153
27012995117,4cyclictest41-21ksoftirqd/321:00:203
27012995116,4cyclictest41-21ksoftirqd/323:25:243
27012995116,4cyclictest41-21ksoftirqd/323:05:143
27012995115,3cyclictest41-21ksoftirqd/322:25:173
27011995130,10cyclictest33-21ksoftirqd/222:45:132
27011995129,10cyclictest33-21ksoftirqd/221:30:012
27011995122,4cyclictest33-21ksoftirqd/200:05:262
2700999514,7cyclictest29126-21ps20:20:180
27012995018,4cyclictest41-21ksoftirqd/300:15:233
27012995018,3cyclictest41-21ksoftirqd/322:55:183
27011995025,4cyclictest33-21ksoftirqd/221:15:302
27011995013,5cyclictest33-21ksoftirqd/200:10:172
2700999503,6cyclictest16257-21grep23:15:170
2700999502,5cyclictest10939-21df20:50:150
2700999501,5cyclictest15128-21sed19:50:190
2700999501,5cyclictest14889-21grep22:05:200
2700999500,8cyclictest101ktimersoftd/021:25:160
27012994921,9cyclictest41-21ksoftirqd/320:15:193
27012994921,9cyclictest41-21ksoftirqd/320:15:183
27011994932,3cyclictest33-21ksoftirqd/219:50:212
27011994930,4cyclictest33-21ksoftirqd/200:20:002
2700999493,6cyclictest13324-21cat22:00:260
2700999492,7cyclictest2466-21sed22:45:180
2700999491,7cyclictest28115-21df_abs23:40:150
2700999491,5cyclictest2749-21grep19:25:190
27012994823,5cyclictest41-21ksoftirqd/320:50:153
27012994820,7cyclictest41-21ksoftirqd/321:05:223
27012994820,4cyclictest41-21ksoftirqd/319:50:203
27012994819,4cyclictest41-21ksoftirqd/323:10:163
27012994819,3cyclictest41-21ksoftirqd/320:00:143
27012994818,3cyclictest41-21ksoftirqd/300:10:153
27012994817,4cyclictest41-21ksoftirqd/322:30:133
27012994816,4cyclictest41-21ksoftirqd/323:31:413
27011994833,4cyclictest33-21ksoftirqd/219:40:012
27011994832,4cyclictest33-21ksoftirqd/223:20:262
27011994830,3cyclictest33-21ksoftirqd/222:30:242
27011994828,3cyclictest33-21ksoftirqd/223:25:192
2700999480,7cyclictest101ktimersoftd/022:30:190
2700999480,7cyclictest101ktimersoftd/020:30:170
27011994738,2cyclictest33-21ksoftirqd/220:30:242
27011994730,3cyclictest33-21ksoftirqd/222:25:152
2700999472,6cyclictest32591-21sed23:50:010
2700999472,6cyclictest101ktimersoftd/023:05:210
2700999470,6cyclictest101ktimersoftd/021:25:000
27012994633,3cyclictest41-21ksoftirqd/322:20:203
27012994619,9cyclictest41-21ksoftirqd/322:45:183
2701299461,3cyclictest41-21ksoftirqd/320:00:003
2701199466,8cyclictest33-21ksoftirqd/221:50:002
2701199465,3cyclictest33-21ksoftirqd/220:10:172
27011994625,9cyclictest33-21ksoftirqd/223:35:182
2700999466,8cyclictest9-21ksoftirqd/023:54:050
2700999462,7cyclictest24607-21grep22:25:150
2700999461,6cyclictest9958-21cut21:55:170
2700999461,6cyclictest23249-21cstates23:30:140
2700999460,6cyclictest19809-21irqrtprio20:00:200
2700999460,6cyclictest101ktimersoftd/022:35:140
2700999460,6cyclictest101ktimersoftd/000:37:590
27012994531,4cyclictest41-21ksoftirqd/319:45:133
27011994530,4cyclictest33-21ksoftirqd/221:40:152
27011994529,4cyclictest33-21ksoftirqd/219:45:012
27011994528,4cyclictest33-21ksoftirqd/221:05:122
27011994527,4cyclictest33-21ksoftirqd/221:35:022
27011994526,10cyclictest33-21ksoftirqd/200:30:182
27011994519,3cyclictest33-21ksoftirqd/221:55:212
2700999454,5cyclictest9-21ksoftirqd/023:20:230
2700999452,5cyclictest101ktimersoftd/000:20:140
2700999452,4cyclictest0-21swapper/019:40:190
2700999451,6cyclictest27754-21cut19:10:200
2700999451,5cyclictest22880-21timerandwakeup20:05:260
2700999451,5cyclictest0-21swapper/022:10:290
27009994514,5cyclictest9-21ksoftirqd/020:45:160
27009994514,5cyclictest9-21ksoftirqd/020:45:160
2700999450,42cyclictest101ktimersoftd/021:45:240
27012994410,6cyclictest41-21ksoftirqd/321:40:243
27011994430,4cyclictest33-21ksoftirqd/222:20:252
27011994429,4cyclictest33-21ksoftirqd/222:55:152
27011994428,5cyclictest33-21ksoftirqd/220:55:262
27011994428,4cyclictest33-21ksoftirqd/219:20:192
27011994428,4cyclictest33-21ksoftirqd/219:20:192
27011994428,4cyclictest33-21ksoftirqd/200:20:192
27011994422,10cyclictest33-21ksoftirqd/223:30:192
27011994419,7cyclictest33-21ksoftirqd/222:35:112
2700999444,7cyclictest9-21ksoftirqd/022:15:160
27012994327,7cyclictest41-21ksoftirqd/321:20:183
27011994329,3cyclictest33-21ksoftirqd/220:05:242
27011994328,3cyclictest33-21ksoftirqd/200:00:292
27011994323,5cyclictest33-21ksoftirqd/222:50:212
2701199432,2cyclictest33-21ksoftirqd/221:55:002
2700999432,6cyclictest7364-21cut00:05:010
2700999431,7cyclictest31329-21sed21:30:300
2700999431,6cyclictest16655-21ps21:00:240
2700999430,6cyclictest101ktimersoftd/023:55:160
27012994227,4cyclictest41-21ksoftirqd/323:35:143
27011994229,4cyclictest33-21ksoftirqd/200:25:152
2700999424,7cyclictest9-21ksoftirqd/023:35:290
2700999423,6cyclictest8641-21cat21:50:270
2700999422,5cyclictest0-21swapper/021:35:170
2700999422,5cyclictest0-21swapper/000:30:230
2700999421,6cyclictest19763-21sed00:30:010
27011994126,4cyclictest33-21ksoftirqd/221:10:252
2700999414,7cyclictest9-21ksoftirqd/022:50:120
2700999413,4cyclictest9-21ksoftirqd/019:49:390
2700999412,7cyclictest11304-21cat00:10:190
2700999411,6cyclictest6893-21basename22:55:160
2700999411,6cyclictest25134-21switchtime20:10:280
2700999410,8cyclictest101ktimersoftd/021:05:270
2700999410,7cyclictest101ktimersoftd/020:35:260
2700999410,7cyclictest101ktimersoftd/019:20:170
2700999410,7cyclictest101ktimersoftd/019:20:160
2700999403,5cyclictest101ktimersoftd/019:30:150
2700999402,6cyclictest9-21ksoftirqd/020:55:130
2700999402,5cyclictest20658-21df21:10:150
2700999402,4cyclictest9-21ksoftirqd/021:41:030
59298390,7rtkit-daemon0-21swapper/122:21:421
2700999392,6cyclictest9-21ksoftirqd/019:55:160
2700999390,7cyclictest101ktimersoftd/020:40:240
59298380,7rtkit-daemon0-21swapper/121:37:361
27010993832,4cyclictest25-21ksoftirqd/100:30:011
2701099370,5cyclictest6432-21sed21:45:271
2700999373,3cyclictest9-21ksoftirqd/023:03:330
2700999370,7cyclictest101ktimersoftd/019:35:260
27010993529,4cyclictest25-21ksoftirqd/121:43:331
27010993529,3cyclictest25-21ksoftirqd/121:55:531
27010993528,5cyclictest25-21ksoftirqd/119:50:001
27010993528,4cyclictest25-21ksoftirqd/100:15:001
27010993513,19cyclictest30022-21sed23:45:001
27010993429,3cyclictest25-21ksoftirqd/119:40:001
27010993428,4cyclictest25-21ksoftirqd/121:15:461
27010993428,4cyclictest25-21ksoftirqd/120:15:331
27010993428,4cyclictest25-21ksoftirqd/120:15:331
27010993428,4cyclictest25-21ksoftirqd/120:08:421
27010993427,5cyclictest25-21ksoftirqd/123:52:551
27010993427,5cyclictest25-21ksoftirqd/122:06:321
27010993427,5cyclictest25-21ksoftirqd/121:26:001
27010993427,5cyclictest25-21ksoftirqd/100:15:371
27010993427,4cyclictest25-21ksoftirqd/122:57:511
27010993414,17cyclictest3827-21memory23:55:211
27010993412,19cyclictest32212-21cat21:35:011
2701099340,3cyclictest21950-21ls21:10:271
2700999342,8cyclictest9-21ksoftirqd/021:19:040
27010993328,3cyclictest25-21ksoftirqd/119:28:591
27010993327,4cyclictest25-21ksoftirqd/122:17:321
27010993327,4cyclictest25-21ksoftirqd/121:21:441
27010993327,4cyclictest25-21ksoftirqd/119:17:231
27010993327,4cyclictest25-21ksoftirqd/100:07:511
27010993326,4cyclictest25-21ksoftirqd/122:15:001
2701099328,20cyclictest18956-21acpi20:00:121
27010993226,4cyclictest25-21ksoftirqd/122:28:541
27010993226,4cyclictest25-21ksoftirqd/120:39:521
27010993226,4cyclictest25-21ksoftirqd/120:20:571
27010993226,4cyclictest25-21ksoftirqd/119:32:271
27010993214,15cyclictest13865-21df_inode23:10:151
27010993211,18cyclictest15498-21entropy00:20:161
27010993211,18cyclictest15355-21cat21:00:021
27010993210,19cyclictest1316-21readlink22:45:001
2700999322,5cyclictest21261-21grep23:25:190
2701099319,19cyclictest21466-21cut23:25:191
2701099319,19cyclictest12044-21cut23:05:221
2701099316,3cyclictest10808-21cpuspeed_turbos20:50:151
27010993126,3cyclictest25-21ksoftirqd/123:15:391
27010993126,3cyclictest25-21ksoftirqd/120:10:571
27010993125,4cyclictest25-21ksoftirqd/122:54:461
27010993125,4cyclictest25-21ksoftirqd/120:32:071
27010993125,4cyclictest25-21ksoftirqd/119:51:381
27010993125,4cyclictest25-21ksoftirqd/119:40:501
27010993125,4cyclictest25-21ksoftirqd/119:22:331
27010993125,4cyclictest25-21ksoftirqd/119:22:321
2701099311,28cyclictest1285-21snmpd20:40:231
2701099310,3cyclictest121rcu_preempt20:45:271
2701099310,3cyclictest121rcu_preempt20:45:271
27010993026,3cyclictest25-21ksoftirqd/123:22:321
27010993025,3cyclictest25-21ksoftirqd/122:32:301
27010993025,3cyclictest25-21ksoftirqd/119:58:271
27010993023,5cyclictest25-21ksoftirqd/123:33:091
2700999302,3cyclictest121rcu_preempt00:15:280
2701099298,3cyclictest10246-21awk23:00:261
27010992924,3cyclictest25-21ksoftirqd/122:41:531
27010992912,15cyclictest16694-21processes21:00:241
27010992911,15cyclictest7632-21idleruntime21:50:181
2701099287,3cyclictest26099-21irqrtprio23:35:181
27010992823,3cyclictest25-21ksoftirqd/120:27:111
27010992823,3cyclictest25-21ksoftirqd/100:36:061
27010992822,4cyclictest25-21ksoftirqd/122:04:591
27010992821,5cyclictest25-21ksoftirqd/123:47:451
2701099280,3cyclictest21592-21users00:30:281
27010992722,3cyclictest25-21ksoftirqd/100:00:481
27010992620,4cyclictest25-21ksoftirqd/121:07:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional