You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 07:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Fri Sep 19, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2083022760,2sleep00-21swapper/019:37:000
964121670,2sleep00-21swapper/020:17:130
1773911050,4ptp4l401ktimersoftd/319:37:023
271232800,2sleep00-21swapper/021:56:090
217132740,5sleep32278899cyclictest20:42:173
22767997028,9cyclictest9-21ksoftirqd/001:02:090
177391670,1ptp4l401ktimersoftd/323:27:573
277472660,2sleep30-21swapper/301:06:023
22776996611,20cyclictest4006-21expr00:37:071
194662660,2sleep32278899cyclictest20:37:193
224382654,10sleep10-21swapper/119:38:561
2277699641,24cyclictest24405-21awk01:02:071
2277699641,24cyclictest11723-21sed00:46:531
264502630,2sleep226447-21sh23:11:102
2277699631,28cyclictest22980-21apt-get23:07:051
2277699620,28cyclictest9774-21cat22:12:191
2277699620,23cyclictest7936-21sed22:11:491
2277699620,23cyclictest27970-21fschecks_time00:27:111
44072610,4sleep02276799cyclictest00:37:120
2277699610,28cyclictest6550-21irqrtprio20:12:081
2277699610,28cyclictest0-21swapper/123:22:211
2277699610,25cyclictest23580-21sed20:47:081
2277699600,28cyclictest14150-21diskmemload00:50:411
2277699600,23cyclictest603-21sed21:07:131
2277699590,28cyclictest7080-21systemctl22:47:141
2277699590,28cyclictest4087-21latency_hist21:16:481
2277699590,22cyclictest1156-21sed22:41:501
2277699580,29cyclictest14150-21diskmemload22:57:541
22767995847,6cyclictest9-21ksoftirqd/023:47:040
22767995847,6cyclictest9-21ksoftirqd/023:47:040
2277699570,26cyclictest0-21swapper/123:32:231
2277699570,22cyclictest21474-21mailstats20:42:111
2277699570,20cyclictest9963-21timerwakeupswit23:27:211
22767995747,6cyclictest9-21ksoftirqd/023:32:070
22767995747,6cyclictest9-21ksoftirqd/021:02:010
177391570,1ptp4l401ktimersoftd/323:05:053
2277699560,22cyclictest29590-21sed19:52:091
2277699560,22cyclictest0-21swapper/122:26:121
2277699560,21cyclictest2667-21rm22:05:001
2277699560,21cyclictest22582-21rm00:58:301
22767995648,4cyclictest9-21ksoftirqd/022:52:030
22767995646,6cyclictest9-21ksoftirqd/020:42:000
22767995631,3cyclictest9-21ksoftirqd/000:12:220
88082550,3sleep10-21swapper/120:17:061
22784995523,10cyclictest33-21ksoftirqd/201:00:142
2277699550,21cyclictest28447-21ps20:57:101
2277699550,21cyclictest10876-21ls20:22:001
2277699550,20cyclictest28394-21rm01:06:581
22767995546,5cyclictest9-21ksoftirqd/022:02:040
22767995523,6cyclictest9-21ksoftirqd/023:31:500
22767995520,10cyclictest9-21ksoftirqd/022:37:100
22784995423,9cyclictest33-21ksoftirqd/222:07:042
22767995445,5cyclictest9-21ksoftirqd/023:26:330
22767995427,4cyclictest9-21ksoftirqd/000:46:530
2278499535,8cyclictest33-21ksoftirqd/222:41:512
22784995325,9cyclictest33-21ksoftirqd/223:12:092
22767995325,16cyclictest9-21ksoftirqd/022:47:070
2278499526,8cyclictest33-21ksoftirqd/223:01:512
22784995224,9cyclictest33-21ksoftirqd/222:06:492
22784995223,10cyclictest33-21ksoftirqd/223:51:542
22784995223,10cyclictest33-21ksoftirqd/223:26:332
22767995225,4cyclictest9-21ksoftirqd/000:22:150
22784995124,9cyclictest33-21ksoftirqd/200:12:102
22784995124,4cyclictest33-21ksoftirqd/222:14:042
22784995123,9cyclictest33-21ksoftirqd/223:17:202
22784995123,9cyclictest33-21ksoftirqd/222:50:402
22784995123,9cyclictest33-21ksoftirqd/200:20:312
22784995122,9cyclictest33-21ksoftirqd/219:51:462
22784995122,9cyclictest33-21ksoftirqd/200:00:112
22767995145,3cyclictest9-21ksoftirqd/022:32:020
22767995142,5cyclictest9-21ksoftirqd/000:57:090
22784995022,9cyclictest33-21ksoftirqd/223:27:192
22784995022,9cyclictest33-21ksoftirqd/200:42:452
22784995021,9cyclictest33-21ksoftirqd/222:30:192
22784995020,8cyclictest33-21ksoftirqd/200:53:032
2277699501,23cyclictest11065-21ssh00:07:141
2277699501,22cyclictest0-21swapper/121:02:191
2276799506,3cyclictest9-21ksoftirqd/000:07:270
177391500,2ptp4l14626-21kworker/3:123:40:183
22784994921,9cyclictest33-21ksoftirqd/222:39:452
22784994920,9cyclictest33-21ksoftirqd/221:48:332
22784994920,9cyclictest33-21ksoftirqd/201:10:272
22784994919,8cyclictest33-21ksoftirqd/221:52:152
22784994918,8cyclictest33-21ksoftirqd/221:27:482
2277699491,21cyclictest0-21swapper/123:47:151
2277699491,21cyclictest0-21swapper/123:47:151
2277699491,19cyclictest0-21swapper/121:42:321
22767994940,4cyclictest9-21ksoftirqd/021:37:020
22767994938,6cyclictest9-21ksoftirqd/021:47:030
22767994931,9cyclictest9-21ksoftirqd/023:42:180
22767994922,6cyclictest9-21ksoftirqd/020:47:170
177391490,0ptp4l401ktimersoftd/322:12:553
2278499487,5cyclictest33-21ksoftirqd/222:22:042
2278499485,9cyclictest33-21ksoftirqd/222:52:092
2278499485,8cyclictest29048-21snmp_o5powerctl00:27:212
22784994838,3cyclictest33-21ksoftirqd/221:57:082
22784994838,3cyclictest33-21ksoftirqd/221:57:082
2278499483,6cyclictest24601-21munin-run20:51:472
22784994834,3cyclictest33-21ksoftirqd/200:47:152
22784994822,4cyclictest33-21ksoftirqd/201:02:092
22784994820,9cyclictest33-21ksoftirqd/200:24:162
22784994820,9cyclictest33-21ksoftirqd/200:02:242
22784994820,7cyclictest33-21ksoftirqd/220:42:162
22784994819,9cyclictest33-21ksoftirqd/200:37:542
22767994826,10cyclictest9-21ksoftirqd/022:57:070
177391480,2ptp4l11509-21kworker/3:122:05:313
139872480,2sleep00-21swapper/020:27:090
2278499476,6cyclictest33-21ksoftirqd/223:42:122
2278499475,7cyclictest33-21ksoftirqd/223:47:112
2278499475,7cyclictest33-21ksoftirqd/223:47:112
2278499474,5cyclictest33-21ksoftirqd/223:32:112
22784994734,3cyclictest33-21ksoftirqd/222:20:262
22784994720,4cyclictest33-21ksoftirqd/200:07:092
22784994719,9cyclictest33-21ksoftirqd/220:54:402
22784994719,9cyclictest33-21ksoftirqd/220:32:402
22784994719,10cyclictest33-21ksoftirqd/222:33:542
22767994720,6cyclictest9-21ksoftirqd/022:07:060
2278499466,6cyclictest33-21ksoftirqd/221:32:022
22784994633,3cyclictest33-21ksoftirqd/223:38:492
22784994633,3cyclictest33-21ksoftirqd/220:26:472
22784994620,9cyclictest33-21ksoftirqd/221:12:152
22784994619,9cyclictest33-21ksoftirqd/219:46:352
2276799468,3cyclictest9-21ksoftirqd/000:27:160
22767994636,5cyclictest9-21ksoftirqd/020:57:000
22767994621,15cyclictest9-21ksoftirqd/023:52:070
22767994620,5cyclictest9-21ksoftirqd/020:12:060
22784994522,3cyclictest33-21ksoftirqd/220:12:132
2277699451,30cyclictest19992-21ssh23:39:531
2277699451,25cyclictest27511-21cpuspeed_turbos23:12:051
22767994536,5cyclictest9-21ksoftirqd/020:32:010
22767994534,3cyclictest9-21ksoftirqd/021:57:080
22767994534,3cyclictest9-21ksoftirqd/021:57:080
22767994518,5cyclictest9-21ksoftirqd/023:07:090
22767994516,6cyclictest9-21ksoftirqd/021:42:090
22767994514,10cyclictest9-21ksoftirqd/022:14:340
2278499446,7cyclictest33-21ksoftirqd/220:07:052
2278499446,7cyclictest33-21ksoftirqd/220:07:052
22784994434,3cyclictest33-21ksoftirqd/200:31:562
22784994430,3cyclictest33-21ksoftirqd/220:39:212
2278499442,11cyclictest18090-21apt-get23:01:552
22784994419,9cyclictest33-21ksoftirqd/221:21:492
22784994419,8cyclictest33-21ksoftirqd/221:42:072
2277699440,24cyclictest12372-21fschecks_count21:37:051
22767994436,4cyclictest9-21ksoftirqd/020:07:000
22767994436,4cyclictest9-21ksoftirqd/020:07:000
22767994435,4cyclictest9-21ksoftirqd/021:12:030
22767994433,3cyclictest9-21ksoftirqd/020:02:170
22767994431,3cyclictest9-21ksoftirqd/000:51:530
22767994423,3cyclictest9-21ksoftirqd/019:42:020
22767994418,4cyclictest9-21ksoftirqd/023:57:240
22767994418,4cyclictest9-21ksoftirqd/021:07:090
22767994417,3cyclictest9-21ksoftirqd/022:17:090
2278499434,6cyclictest33-21ksoftirqd/219:57:012
2278499432,7cyclictest33-21ksoftirqd/220:57:172
2277699431,24cyclictest5833-21timerandwakeup21:17:171
2277699430,25cyclictest21279-21ssh23:42:051
2277699430,23cyclictest26055-21/usr/sbin/munin22:32:081
2277699430,23cyclictest19324-21chrt00:55:281
22767994336,4cyclictest9-21ksoftirqd/022:21:540
22767994329,6cyclictest9-21ksoftirqd/023:12:130
22767994320,7cyclictest9-21ksoftirqd/021:17:070
22767994317,5cyclictest9-21ksoftirqd/001:07:230
22767994316,4cyclictest9-21ksoftirqd/022:42:110
2278499423,8cyclictest33-21ksoftirqd/221:22:182
22784994231,3cyclictest33-21ksoftirqd/221:07:122
2278499420,6cyclictest33-21ksoftirqd/221:02:142
2277699421,27cyclictest15999-21snmp_o5powerctl00:12:191
2277699421,21cyclictest25507-21apt-config19:46:461
22767994214,6cyclictest9-21ksoftirqd/000:54:340
2278499411,7cyclictest33-21ksoftirqd/221:37:062
22784994117,5cyclictest33-21ksoftirqd/220:27:112
2277699410,25cyclictest7762-21grep00:02:251
2277699410,21cyclictest0-21swapper/121:32:111
2277699410,20cyclictest0-21swapper/123:59:511
22767994115,7cyclictest9-21ksoftirqd/000:32:240
2276799410,9cyclictest20036-21/usr/sbin/munin23:02:160
162722410,1sleep316273-21dpkg22:21:493
22788994030,4cyclictest41-21ksoftirqd/323:12:043
2278499404,6cyclictest33-21ksoftirqd/219:52:102
2278499401,7cyclictest33-21ksoftirqd/219:41:452
2278499401,6cyclictest33-21ksoftirqd/220:01:592
2277699401,26cyclictest20480-21unixbench_singl23:02:261
2277699401,23cyclictest27056-21sed20:56:481
2277699400,24cyclictest24591-21mailstats00:22:171
2277699400,21cyclictest14150-21diskmemload21:58:461
2277699400,21cyclictest14150-21diskmemload21:58:461
22767994030,3cyclictest9-21ksoftirqd/019:47:030
22767994028,4cyclictest9-21ksoftirqd/000:17:120
22767994023,3cyclictest9-21ksoftirqd/023:17:140
22767994016,3cyclictest9-21ksoftirqd/023:37:150
2278499395,6cyclictest33-21ksoftirqd/220:16:472
2277699391,27cyclictest14150-21diskmemload00:20:541
2277699391,23cyclictest19932-21expr21:47:101
2277699391,23cyclictest19413-21awk20:37:191
2277699390,28cyclictest0-21swapper/123:52:091
2277699390,23cyclictest32664-21unixbench_singl19:57:171
2277699390,23cyclictest1428-21acpi22:42:031
2277699390,23cyclictest14150-21diskmemload23:17:511
2277699390,22cyclictest0-21swapper/122:31:501
22767993933,3cyclictest9-21ksoftirqd/020:26:470
2276799392,4cyclictest9-21ksoftirqd/022:31:200
22767993913,4cyclictest9-21ksoftirqd/021:32:020
177391390,1ptp4l401ktimersoftd/323:20:053
177391390,1ptp4l401ktimersoftd/321:52:193
177391390,1ptp4l401ktimersoftd/321:47:013
177391390,1ptp4l401ktimersoftd/321:42:283
22767993832,3cyclictest9-21ksoftirqd/000:02:080
177391380,1ptp4l401ktimersoftd/322:57:213
177391380,1ptp4l401ktimersoftd/322:52:333
177391380,1ptp4l401ktimersoftd/321:24:423
177391380,1ptp4l401ktimersoftd/300:44:023
177391380,1ptp4l401ktimersoftd/300:37:413
177391380,1ptp4l401ktimersoftd/300:22:533
2277699371,22cyclictest31978-21/usr/sbin/munin00:32:141
2277699371,22cyclictest13835-21snmp_o5powerctl22:17:161
2277699371,20cyclictest0-21swapper/120:02:091
2277699370,26cyclictest0-21swapper/120:36:471
2277699370,21cyclictest24324-21systemctl19:42:091
2277699370,21cyclictest0-21swapper/121:52:031
177391370,1ptp4l401ktimersoftd/323:42:413
177391370,1ptp4l401ktimersoftd/323:33:593
177391370,1ptp4l401ktimersoftd/323:23:063
177391370,1ptp4l401ktimersoftd/322:27:093
177391370,1ptp4l401ktimersoftd/322:26:043
177391370,1ptp4l401ktimersoftd/300:14:033
177391370,1ptp4l401ktimersoftd/300:03:183
22767993629,4cyclictest9-21ksoftirqd/019:57:040
22767993625,3cyclictest9-21ksoftirqd/020:37:090
22767993624,3cyclictest9-21ksoftirqd/021:22:090
22767993620,4cyclictest9-21ksoftirqd/019:52:080
177391360,1ptp4l401ktimersoftd/300:36:163
22788993530,3cyclictest41-21ksoftirqd/322:46:503
2277699352,29cyclictest9944-21apt-get22:52:021
2277699350,21cyclictest0-21swapper/120:31:471
22767993529,3cyclictest9-21ksoftirqd/020:52:040
177391350,1ptp4l401ktimersoftd/322:32:453
177391350,1ptp4l401ktimersoftd/321:56:563
177391350,1ptp4l401ktimersoftd/321:56:563
177391350,1ptp4l401ktimersoftd/300:49:113
177391350,0ptp4l401ktimersoftd/323:06:563
22788993429,3cyclictest41-21ksoftirqd/301:11:533
22776993414,17cyclictest4549-21ptp4l20:07:111
22776993414,17cyclictest4549-21ptp4l20:07:111
22767993424,3cyclictest9-21ksoftirqd/021:31:480
177391340,1ptp4l401ktimersoftd/322:09:493
177391340,1ptp4l401ktimersoftd/300:31:433
177391330,2ptp4l12826-21kworker/3:120:15:313
177391330,1ptp4l401ktimersoftd/323:52:333
177391330,1ptp4l401ktimersoftd/300:20:193
22788993227,3cyclictest41-21ksoftirqd/320:22:053
22788993226,4cyclictest41-21ksoftirqd/300:07:143
22788993226,3cyclictest41-21ksoftirqd/320:47:003
22788993225,4cyclictest41-21ksoftirqd/319:46:473
177391320,1ptp4l401ktimersoftd/322:39:533
177391320,1ptp4l401ktimersoftd/321:30:583
177391320,1ptp4l401ktimersoftd/321:07:053
177391320,1ptp4l401ktimersoftd/300:54:173
22788993125,3cyclictest41-21ksoftirqd/321:02:193
177391310,1ptp4l401ktimersoftd/323:49:553
177391310,1ptp4l401ktimersoftd/323:49:553
177391310,1ptp4l401ktimersoftd/321:39:413
177391310,10ptp4l401ktimersoftd/320:26:573
177391310,0ptp4l401ktimersoftd/320:59:433
22788993024,3cyclictest41-21ksoftirqd/319:46:463
177391300,9ptp4l401ktimersoftd/321:33:183
22788992924,3cyclictest41-21ksoftirqd/320:07:073
22788992924,3cyclictest41-21ksoftirqd/320:07:073
177391290,7ptp4l401ktimersoftd/320:54:553
177391290,1ptp4l401ktimersoftd/322:51:303
22788992823,3cyclictest41-21ksoftirqd/319:52:083
22788992823,3cyclictest41-21ksoftirqd/300:57:153
22788992822,3cyclictest41-21ksoftirqd/320:32:013
2277699280,24cyclictest8046-21grep21:22:141
22788992722,3cyclictest41-21ksoftirqd/321:12:093
2277699270,24cyclictest9391-21turbostat.cron21:31:481
22788992620,3cyclictest41-21ksoftirqd/320:18:053
177391260,1ptp4l401ktimersoftd/323:59:293
2278899240,2cyclictest121rcu_preempt19:57:043
177391240,1ptp4l401ktimersoftd/320:02:193
177391240,0ptp4l401ktimersoftd/321:17:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional