You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 08:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot1.osadl.org (updated Thu Sep 18, 2025 00:45:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2397821280,7sleep22780899cyclictest20:10:192
27806997515,48cyclictest11889-21df_inode22:10:160
2780699745,56cyclictest25623-1awk23:50:000
27806997214,16cyclictest30448-21cpuspeed_turbos20:25:140
27806996911,11cyclictest20773-21idleruntime-cro20:05:000
27806996816,9cyclictest4705-21cut20:40:000
27806996612,10cyclictest28305-21hwlatdetect19:10:170
27808996521,4cyclictest33-21ksoftirqd/219:45:192
27806996419,10cyclictest6930-21taskset20:44:310
27806996412,10cyclictest30058-21unixbench_singl23:55:300
2847191630,3ptp4l0-21swapper/321:40:263
27808996319,9cyclictest33-21ksoftirqd/200:00:172
27806996317,10cyclictest14219-21taskset00:30:480
27806996315,9cyclictest31470-21sed00:00:170
27806996315,10cyclictest1507-21cat22:55:280
27806996315,10cyclictest1507-21cat22:55:280
27806996312,15cyclictest14089-21wc22:15:140
27806996310,12cyclictest3924-21irqrtprio00:10:220
27806996213,14cyclictest18775-21cpuspeed_turbos23:35:160
27806996211,11cyclictest24036-21kernelversion22:35:200
27806996210,11cyclictest7837-21cut22:00:200
27806996210,11cyclictest7476-21df_abs20:45:140
2847191610,4ptp4l26119-21iostat22:40:182
2847191610,3ptp4l0-21swapper/123:40:051
27808996126,4cyclictest33-21ksoftirqd/222:20:002
27806996116,10cyclictest16761-21taskset21:06:120
27806996112,10cyclictest28077-21df_abs22:45:130
27806996111,8cyclictest9541-21df_abs22:05:170
27806996111,11cyclictest23533-21mailstats21:20:250
27806996111,11cyclictest16142-21latency_hist19:55:000
27806996111,10cyclictest5663-21latency23:05:200
27808996026,5cyclictest33-21ksoftirqd/222:30:002
27806996013,11cyclictest11042-21unixbench_singl23:15:270
27806996012,8cyclictest4660-21sed23:05:000
27806996011,11cyclictest14281-21sed23:25:140
27806996011,11cyclictest14281-21sed23:25:140
27806996010,12cyclictest1363-21irqrtprio00:05:220
27806996010,12cyclictest10396-21wc00:25:130
27806996010,11cyclictest30890-21sed21:35:300
27806996010,10cyclictest13052-21grep19:45:250
2847191590,4ptp4l0-21swapper/100:25:231
2847191590,3ptp4l0-21swapper/123:52:541
2847191590,3ptp4l0-21swapper/121:03:271
2847191590,2ptp4l0-21swapper/220:20:012
27808995926,4cyclictest33-21ksoftirqd/219:39:302
27808995915,9cyclictest33-21ksoftirqd/221:22:092
27808995914,8cyclictest33-21ksoftirqd/223:20:282
27806995919,10cyclictest1238-21taskset21:43:240
27806995918,9cyclictest18070-21runrttasks22:22:250
27806995918,9cyclictest18070-21runrttasks22:22:240
27806995918,10cyclictest2177-21taskset19:24:440
27806995913,16cyclictest6912-21date19:35:000
27806995912,9cyclictest27596-21cut21:30:210
27806995912,9cyclictest1984-21df_abs21:45:130
27806995912,8cyclictest6433-21grep00:15:220
27806995912,35cyclictest28920-21cat20:20:200
27806995910,11cyclictest11899-21cat20:55:000
27806995813,11cyclictest9782-21tune2fs19:40:160
27806995812,17cyclictest18040-21irqrtprio21:10:160
27806995812,11cyclictest16549-21df_abs19:55:140
27806995810,10cyclictest16570-21df_abs23:30:110
2847191570,3ptp4l0-21swapper/223:27:062
2847191570,3ptp4l0-21swapper/223:27:062
2847191570,3ptp4l0-21swapper/021:15:190
27808995725,4cyclictest33-21ksoftirqd/223:51:212
2780699579,10cyclictest23279-21latency_hist23:45:010
2780699578,12cyclictest25608-21ntpq21:25:230
27806995719,10cyclictest9017-21seq23:13:230
27806995714,10cyclictest27536-21sed23:50:290
27806995713,17cyclictest1878-21awk20:30:270
27806995713,17cyclictest14609-21df_abs21:00:150
27806995713,11cyclictest24318-21uname20:10:220
27806995712,12cyclictest30245-21cpuspeed22:50:130
27806995712,10cyclictest18906-21fschecks_count22:25:140
27806995710,11cyclictest8306-21grep00:20:160
27806995710,10cyclictest13262-21proc_pri20:55:240
2847191560,4ptp4l0-21swapper/200:24:452
2847191560,4ptp4l0-21swapper/123:45:411
2847191560,4ptp4l0-21swapper/122:54:271
2847191560,3ptp4l0-21swapper/119:46:491
27808995619,4cyclictest33-21ksoftirqd/220:05:262
27808995616,9cyclictest33-21ksoftirqd/219:15:012
27808995611,9cyclictest33-21ksoftirqd/200:35:292
27806995613,16cyclictest21258-21grep22:30:160
2847191550,4ptp4l0-21swapper/323:39:233
2847191550,4ptp4l0-21swapper/323:13:463
2847191550,4ptp4l0-21swapper/122:37:461
2847191550,4ptp4l0-21swapper/119:38:411
2847191550,4ptp4l0-21swapper/119:32:231
2847191550,3ptp4l0-21swapper/119:59:271
27808995522,6cyclictest33-21ksoftirqd/200:00:002
27808995518,9cyclictest33-21ksoftirqd/200:25:152
27806995518,10cyclictest11704-21taskset23:20:040
2847191540,4ptp4l0-21swapper/219:51:452
2847191540,4ptp4l0-21swapper/121:07:071
2847191540,4ptp4l0-21swapper/120:33:091
2847191540,4ptp4l0-21swapper/120:23:541
2847191540,4ptp4l0-21swapper/119:21:071
27808995421,9cyclictest33-21ksoftirqd/221:55:222
27808995420,4cyclictest33-21ksoftirqd/221:10:002
27808995416,4cyclictest33-21ksoftirqd/219:55:142
27808995411,9cyclictest33-21ksoftirqd/222:30:212
27806995417,9cyclictest6555-21taskset21:58:230
27806995411,17cyclictest1299-21runrttasks00:39:420
2847191530,4ptp4l0-21swapper/122:20:121
2847191530,4ptp4l0-21swapper/122:20:121
2847191530,4ptp4l0-21swapper/100:34:271
27808995320,8cyclictest33-21ksoftirqd/221:30:242
27806995317,11cyclictest27653-21taskset20:19:150
2780699530,13cyclictest0-21swapper/022:40:170
2847191520,4ptp4l0-21swapper/221:42:582
2847191520,4ptp4l0-21swapper/221:25:162
2847191520,4ptp4l0-21swapper/120:02:011
2847191520,3ptp4l0-21swapper/120:43:091
27808995218,8cyclictest33-21ksoftirqd/223:40:212
27808995215,9cyclictest33-21ksoftirqd/220:45:142
2847191510,5ptp4l0-21swapper/121:34:431
2847191510,4ptp4l0-21swapper/122:15:001
2847191510,4ptp4l0-21swapper/121:17:361
2847191510,3ptp4l0-21swapper/320:24:573
2847191510,3ptp4l0-21swapper/121:49:161
27808995122,4cyclictest33-21ksoftirqd/220:20:142
27808995119,7cyclictest33-21ksoftirqd/222:35:142
27808995117,4cyclictest33-21ksoftirqd/221:00:192
27808995115,4cyclictest33-21ksoftirqd/222:10:172
27806995110,7cyclictest21181-21df20:05:150
2847191500,9ptp4l26035-21iostat19:05:170
2847191500,4ptp4l0-21swapper/121:38:001
2780899507,3cyclictest33-21ksoftirqd/220:40:002
27808995027,3cyclictest33-21ksoftirqd/222:50:252
27808995013,8cyclictest33-21ksoftirqd/221:10:152
27807995017,8cyclictest25-21ksoftirqd/100:20:001
27807995015,8cyclictest25-21ksoftirqd/119:55:001
2847191490,4ptp4l0-21swapper/223:45:082
2847191490,4ptp4l0-21swapper/223:10:592
2847191490,3ptp4l0-21swapper/123:28:421
2847191490,3ptp4l0-21swapper/123:28:421
2847191490,3ptp4l0-21swapper/120:45:371
27808994933,3cyclictest33-21ksoftirqd/219:34:392
27808994921,8cyclictest33-21ksoftirqd/222:05:002
27808994915,4cyclictest33-21ksoftirqd/219:20:182
27808994915,4cyclictest33-21ksoftirqd/200:05:182
27808994915,3cyclictest33-21ksoftirqd/221:15:282
27807994917,4cyclictest25-21ksoftirqd/121:00:001
2847191480,4ptp4l0-21swapper/122:09:001
2847191480,4ptp4l0-21swapper/100:08:401
2780999482,3cyclictest21694-21cron21:20:003
27808994831,3cyclictest33-21ksoftirqd/220:50:412
27807994817,9cyclictest25-21ksoftirqd/120:50:181
27806994816,10cyclictest4338-21taskset21:54:350
2847191470,7ptp4l27529-21ls19:10:001
2847191470,4ptp4l0-21swapper/100:20:141
2847191470,3ptp4l0-21swapper/322:40:063
2847191470,11ptp4l23226-21grep21:20:213
27808994722,4cyclictest33-21ksoftirqd/222:00:282
27808994721,7cyclictest33-21ksoftirqd/220:30:002
2780899472,14cyclictest0-21swapper/221:37:112
27806994713,6cyclictest2849491getstats19:25:040
2847191460,4ptp4l0-21swapper/122:01:061
2780899465,3cyclictest33-21ksoftirqd/219:15:222
27808994616,8cyclictest33-21ksoftirqd/200:35:002
27808994615,4cyclictest33-21ksoftirqd/220:40:232
27807994615,4cyclictest25-21ksoftirqd/119:25:531
2847191450,11ptp4l0-21swapper/221:51:202
27808994533,3cyclictest33-21ksoftirqd/200:10:272
27808994518,4cyclictest33-21ksoftirqd/223:00:202
27807994514,4cyclictest25-21ksoftirqd/120:05:201
2847191440,4ptp4l29396-21apt-get21:35:153
2847191440,4ptp4l18524-21apt-get22:25:121
2847191440,4ptp4l14040-21apt-get23:25:143
2847191440,4ptp4l14040-21apt-get23:25:143
2847191440,4ptp4l0-21swapper/123:00:501
2847191440,4ptp4l0-21swapper/121:23:571
27809994414,6cyclictest41-21ksoftirqd/322:00:213
27807994418,8cyclictest25-21ksoftirqd/121:15:011
27807994416,7cyclictest25-21ksoftirqd/123:05:201
27807994416,4cyclictest25-21ksoftirqd/122:55:311
27807994416,4cyclictest25-21ksoftirqd/122:55:311
2847191430,9ptp4l0-21swapper/319:23:273
2847191430,5ptp4l27854-21apt-get22:45:123
2847191430,5ptp4l0-21swapper/221:45:102
2847191430,4ptp4l0-21swapper/119:44:161
2847191430,4ptp4l0-21swapper/119:13:311
2847191430,4ptp4l0-21swapper/100:38:141
2847191430,3ptp4l0-21swapper/219:41:252
2780899434,3cyclictest33-21ksoftirqd/220:03:332
27808994331,2cyclictest33-21ksoftirqd/222:59:132
27808994331,2cyclictest33-21ksoftirqd/222:59:132
27808994327,5cyclictest33-21ksoftirqd/223:30:262
2780899431,5cyclictest33-21ksoftirqd/223:39:212
27808994311,6cyclictest33-21ksoftirqd/222:45:222
27807994314,3cyclictest25-21ksoftirqd/121:55:161
27807994313,6cyclictest25-21ksoftirqd/123:35:301
27807994313,4cyclictest25-21ksoftirqd/120:25:271
2847191420,5ptp4l0-21swapper/320:05:213
2847191420,5ptp4l0-21swapper/122:40:201
2847191420,4ptp4l25625-21ntp_states21:25:233
2847191420,4ptp4l21693-21irqstats22:30:201
2847191420,4ptp4l1637-21apt-get21:45:103
2847191420,4ptp4l0-21swapper/323:55:453
2847191420,4ptp4l0-21swapper/321:33:003
2847191420,4ptp4l0-21swapper/123:31:361
2847191420,4ptp4l0-21swapper/120:37:491
2847191420,4ptp4l0-21swapper/120:17:591
2847191420,3ptp4l0-21swapper/322:27:243
2847191420,2ptp4l0-21swapper/321:09:393
2780899423,5cyclictest33-21ksoftirqd/222:20:262
2780899423,5cyclictest33-21ksoftirqd/222:20:252
2780899423,3cyclictest33-21ksoftirqd/223:05:162
2780899422,3cyclictest33-21ksoftirqd/223:15:572
2780899421,2cyclictest121rcu_preempt00:19:592
27808994211,3cyclictest33-21ksoftirqd/219:25:002
27807994220,6cyclictest25-21ksoftirqd/123:59:561
27807994212,8cyclictest25-21ksoftirqd/123:15:281
27807994211,7cyclictest25-21ksoftirqd/119:15:211
2847191410,5ptp4l15521-21ntpq21:00:233
2847191410,5ptp4l11949-21df_abs23:20:163
2847191410,5ptp4l0-21swapper/323:05:233
2847191410,5ptp4l0-21swapper/322:22:223
2847191410,5ptp4l0-21swapper/322:22:223
2847191410,4ptp4l24114-21meminfo22:35:223
2847191410,4ptp4l0-21swapper/322:15:243
2847191410,4ptp4l0-21swapper/320:01:163
2847191410,4ptp4l0-21swapper/122:15:201
2847191410,4ptp4l0-21swapper/120:10:111
2847191410,4ptp4l0-21swapper/100:00:581
2847191410,3ptp4l7403-21df_inode23:10:171
27809994129,10cyclictest41-21ksoftirqd/323:40:293
2780899414,7cyclictest33-21ksoftirqd/220:30:192
27807994114,6cyclictest25-21ksoftirqd/121:45:001
2847191400,5ptp4l0-21swapper/019:15:050
2847191400,4ptp4l0-21swapper/323:30:243
2847191400,4ptp4l0-21swapper/322:50:133
2847191400,4ptp4l0-21swapper/322:30:443
2847191400,4ptp4l0-21swapper/322:05:123
2847191400,4ptp4l0-21swapper/321:57:503
2847191400,4ptp4l0-21swapper/321:14:323
2847191400,4ptp4l0-21swapper/320:39:593
2847191400,4ptp4l0-21swapper/320:25:233
2847191400,4ptp4l0-21swapper/319:56:073
2847191400,4ptp4l0-21swapper/319:18:453
2847191400,4ptp4l0-21swapper/123:23:531
2847191400,4ptp4l0-21swapper/121:51:511
2847191400,3ptp4l7391-21diskstats19:35:150
2847191400,3ptp4l4362-21ntp_states00:10:271
2847191400,3ptp4l11350-21/usr/sbin/munin00:25:243
2847191400,3ptp4l0-21swapper/220:55:292
27809994028,4cyclictest41-21ksoftirqd/319:30:283
2780999402,5cyclictest121rcu_preempt23:20:003
2847191390,4ptp4l0-21swapper/323:51:273
2847191390,4ptp4l0-21swapper/322:14:563
2847191390,4ptp4l0-21swapper/321:52:293
2847191390,4ptp4l0-21swapper/320:55:133
2847191390,4ptp4l0-21swapper/320:50:013
2847191390,4ptp4l0-21swapper/320:45:113
2847191390,4ptp4l0-21swapper/320:17:433
2847191390,4ptp4l0-21swapper/320:11:433
2847191390,4ptp4l0-21swapper/319:47:363
2847191390,4ptp4l0-21swapper/319:35:553
2847191390,4ptp4l0-21swapper/300:24:073
2847191390,4ptp4l0-21swapper/300:17:393
2847191390,4ptp4l0-21swapper/300:10:513
2847191390,4ptp4l0-21swapper/300:02:273
2847191390,4ptp4l0-21swapper/122:46:381
2847191390,4ptp4l0-21swapper/121:27:461
2847191390,3ptp4l0-21swapper/319:40:173
2847191390,3ptp4l0-21swapper/319:25:513
2847191390,3ptp4l0-21swapper/300:31:263
27809993927,4cyclictest41-21ksoftirqd/323:00:143
27809993925,4cyclictest41-21ksoftirqd/320:40:253
2847191380,4ptp4l0-21swapper/322:55:583
2847191380,4ptp4l0-21swapper/322:55:583
2847191380,4ptp4l0-21swapper/300:07:543
2847191380,3ptp4l0-21swapper/323:47:133
2847191380,3ptp4l0-21swapper/320:30:473
2847191380,3ptp4l0-21swapper/319:51:433
2847191380,3ptp4l0-21swapper/300:35:143
2847191370,4ptp4l0-21swapper/319:10:313
2849691245,11phc2sys0-21swapper/319:05:253
2849691153,7phc2sys0-21swapper/219:07:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional