You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 13:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Sat Jul 12, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1518912120,5ptp4l401ktimersoftd/322:04:453
818721620,4sleep2746599cyclictest00:49:332
301121590,5sleep2746599cyclictest00:43:072
2956121570,5sleep0745399cyclictest00:35:420
326132620,2sleep30-21swapper/303:05:243
151891590,1ptp4l401ktimersoftd/302:25:373
151891590,1ptp4l401ktimersoftd/301:49:143
151891590,1ptp4l401ktimersoftd/301:41:523
151891590,1ptp4l401ktimersoftd/300:50:373
151891590,1ptp4l401ktimersoftd/300:50:373
201312580,2sleep00-21swapper/003:30:110
73002574,40sleep00-21swapper/022:04:310
151891560,1ptp4l401ktimersoftd/302:59:033
745999556,17cyclictest9618-21ssh03:15:351
745999547,13cyclictest26850-21cat01:45:371
41792540,2sleep10-21swapper/101:55:491
151891540,1ptp4l401ktimersoftd/301:10:063
745999537,12cyclictest14543-21if_ens323:25:281
151891530,1ptp4l401ktimersoftd/303:00:583
151891520,1ptp4l401ktimersoftd/300:45:343
745999517,19cyclictest24324-21unixbench_singl22:35:431
745999516,13cyclictest16115-21expr02:10:291
745999506,13cyclictest27093-21cstates01:10:301
745999505,12cyclictest358-21diskmemload00:47:061
7459994910,13cyclictest13363-21ssh00:19:091
745999478,9cyclictest10400-21snmp_o5powerctl00:50:431
745999478,9cyclictest10400-21snmp_o5powerctl00:50:431
745999465,16cyclictest9356-21ssh02:02:151
745999458,9cyclictest20774-21munin-run23:40:111
745999452,11cyclictest0-21swapper/122:20:321
151891450,2ptp4l30176-21kworker/3:102:15:103
745999442,17cyclictest0-21swapper/102:10:071
151891440,2ptp4l30176-21kworker/3:101:20:063
745999437,9cyclictest19366-21snmp_o5powerctl01:00:381
135442420,4sleep233-21ksoftirqd/202:06:382
745999414,11cyclictest0-21swapper/100:05:301
151891410,1ptp4l401ktimersoftd/303:20:293
745999407,16cyclictest24787-21snmp_o5powerctl23:45:381
151891390,15ptp4l401ktimersoftd/303:11:563
745999384,11cyclictest0-21swapper/123:15:101
7459993820,9cyclictest20531-21apt-get03:30:291
151891380,1ptp4l401ktimersoftd/322:05:343
151891380,1ptp4l401ktimersoftd/303:15:273
151891380,1ptp4l401ktimersoftd/302:50:403
151891380,1ptp4l401ktimersoftd/301:54:593
142682380,4sleep2746599cyclictest22:15:292
745999379,18cyclictest27251-21ssh00:34:391
745999379,14cyclictest9799-21service22:10:091
745999378,17cyclictest29277-21/usr/sbin/munin03:00:341
745999378,15cyclictest3416-21apt-get01:20:251
745999377,17cyclictest358-21diskmemload02:42:131
745999373,11cyclictest0-21swapper/102:59:071
7459993724,7cyclictest30239-21apt-get01:50:271
151891370,2ptp4l30176-21kworker/3:101:55:463
151891370,1ptp4l401ktimersoftd/302:41:153
151891370,1ptp4l401ktimersoftd/301:28:563
151891370,1ptp4l401ktimersoftd/301:25:053
151891370,1ptp4l401ktimersoftd/301:13:333
151891370,1ptp4l401ktimersoftd/301:02:403
151891370,1ptp4l401ktimersoftd/300:33:113
745999367,15cyclictest12376-21apt-get01:30:271
151891360,1ptp4l401ktimersoftd/302:35:303
151891360,1ptp4l401ktimersoftd/302:35:303
151891360,1ptp4l401ktimersoftd/302:09:243
151891360,1ptp4l401ktimersoftd/300:25:373
745999358,13cyclictest14502-21/usr/sbin/munin00:55:351
234662350,5sleep233-21ksoftirqd/202:18:022
151891350,2ptp4l26419-21kworker/3:202:34:563
151891350,1ptp4l401ktimersoftd/302:25:033
151891350,12ptp4l401ktimersoftd/300:35:343
745999348,8cyclictest21065-21timerwakeupswit02:50:451
745999347,23cyclictest13756-21ls23:25:111
7459993421,7cyclictest27395-21apt-get22:45:231
7453993427,4cyclictest23576-21kworker/0:000:20:310
72352342,19sleep11033-21snmpd22:03:391
151891340,1ptp4l401ktimersoftd/302:47:033
151891340,1ptp4l401ktimersoftd/302:19:593
151891340,1ptp4l401ktimersoftd/300:23:043
151891340,0ptp4l401ktimersoftd/302:00:243
745999338,8cyclictest32717-21apt-get03:05:291
745999338,8cyclictest31395-21apt-get01:15:261
745999338,8cyclictest16736-21apt-get03:25:301
745999336,14cyclictest15269-21df02:45:311
7459993320,5cyclictest16321-21apt-get23:30:231
151891330,1ptp4l401ktimersoftd/323:03:553
151891330,1ptp4l401ktimersoftd/303:29:543
151891330,1ptp4l401ktimersoftd/300:07:473
151891330,1ptp4l401ktimersoftd/300:00:363
745999327,9cyclictest8583-21ssh01:25:321
745999326,13cyclictest358-21diskmemload03:20:591
745999323,10cyclictest5287-21ssh02:34:331
7459993219,7cyclictest29761-21apt-get22:50:261
151891320,1ptp4l401ktimersoftd/323:58:073
151891320,1ptp4l401ktimersoftd/323:21:213
151891320,1ptp4l401ktimersoftd/322:53:043
151891320,1ptp4l401ktimersoftd/301:37:033
151891320,1ptp4l401ktimersoftd/300:57:313
151891320,1ptp4l401ktimersoftd/300:13:343
745999316,11cyclictest0-21swapper/102:38:341
745999316,11cyclictest0-21swapper/102:38:341
7453993120,9cyclictest9-21ksoftirqd/002:15:320
151891310,1ptp4l401ktimersoftd/323:48:493
151891310,1ptp4l401ktimersoftd/323:26:013
151891310,1ptp4l401ktimersoftd/323:05:463
151891310,1ptp4l401ktimersoftd/323:05:463
151891310,1ptp4l401ktimersoftd/322:55:393
151891310,1ptp4l401ktimersoftd/322:43:033
151891310,1ptp4l401ktimersoftd/322:30:343
151891310,1ptp4l401ktimersoftd/322:15:133
151891310,1ptp4l401ktimersoftd/300:40:143
7465993024,4cyclictest33-21ksoftirqd/201:15:132
7465993023,4cyclictest33-21ksoftirqd/202:52:152
7465993016,4cyclictest33-21ksoftirqd/201:26:192
7465993015,4cyclictest33-21ksoftirqd/222:31:542
745999307,9cyclictest4432-21apt03:10:291
745999304,10cyclictest0-21swapper/100:25:411
745999302,12cyclictest0-21swapper/122:25:321
7459993017,9cyclictest15939-21snmp_o5powerctl00:20:401
7453993024,3cyclictest9-21ksoftirqd/000:25:310
70062306,10sleep20-21swapper/222:00:422
151891300,0ptp4l401ktimersoftd/323:35:503
7453992924,3cyclictest9-21ksoftirqd/001:30:140
7453992923,3cyclictest9-21ksoftirqd/023:35:260
7453992923,3cyclictest9-21ksoftirqd/022:10:140
7453992923,3cyclictest9-21ksoftirqd/003:10:160
7453992923,3cyclictest9-21ksoftirqd/002:00:270
7453992923,3cyclictest9-21ksoftirqd/001:30:280
320352290,2sleep00-21swapper/003:04:370
151891290,1ptp4l401ktimersoftd/323:42:243
7474992822,3cyclictest41-21ksoftirqd/323:54:253
7474992821,4cyclictest41-21ksoftirqd/322:12:283
7465992822,3cyclictest33-21ksoftirqd/201:21:572
745999283,10cyclictest0-21swapper/100:00:121
7459992822,3cyclictest25-21ksoftirqd/122:16:441
745999282,10cyclictest0-21swapper/102:17:581
745999282,10cyclictest0-21swapper/100:12:501
7459992818,5cyclictest22434-21apt-get01:05:271
7459992812,7cyclictest21868-21cat01:40:311
7453992822,3cyclictest9-21ksoftirqd/023:55:110
7453992822,3cyclictest9-21ksoftirqd/022:55:250
7453992822,3cyclictest9-21ksoftirqd/022:10:100
151891280,1ptp4l401ktimersoftd/322:23:153
89322270,3sleep2746599cyclictest00:14:162
7465992722,3cyclictest33-21ksoftirqd/200:23:312
7465992721,3cyclictest33-21ksoftirqd/222:24:312
7465992720,4cyclictest33-21ksoftirqd/223:24:182
7465992720,4cyclictest33-21ksoftirqd/222:58:522
7465992720,4cyclictest33-21ksoftirqd/222:29:222
7465992720,4cyclictest33-21ksoftirqd/203:19:172
746599271,23cyclictest2998-21snmp_o5powerctl02:30:452
745999279,15cyclictest10882-21unixbench_singl23:15:421
745999272,10cyclictest0-21swapper/100:37:311
7459992711,13cyclictest26431-21snmp_o5powerctl02:20:411
7453992722,3cyclictest9-21ksoftirqd/002:35:350
7453992722,3cyclictest9-21ksoftirqd/002:35:350
7453992722,3cyclictest9-21ksoftirqd/001:35:400
7453992722,3cyclictest9-21ksoftirqd/001:00:320
7453992721,3cyclictest9-21ksoftirqd/003:30:580
7453992721,3cyclictest9-21ksoftirqd/002:45:360
7453992721,3cyclictest9-21ksoftirqd/002:25:280
7453992720,4cyclictest9-21ksoftirqd/023:42:020
234432270,4sleep09-21ksoftirqd/023:45:230
151891270,10ptp4l401ktimersoftd/322:48:023
7465992620,3cyclictest33-21ksoftirqd/223:55:112
7465992620,3cyclictest33-21ksoftirqd/223:33:112
7465992619,4cyclictest33-21ksoftirqd/223:01:292
7465992619,4cyclictest33-21ksoftirqd/222:10:432
7465992619,4cyclictest33-21ksoftirqd/201:39:032
7465992619,4cyclictest33-21ksoftirqd/201:31:042
7465992619,4cyclictest33-21ksoftirqd/200:52:462
7465992619,4cyclictest33-21ksoftirqd/200:52:462
7459992614,8cyclictest1779-21unixbench_singl00:40:421
7459992614,8cyclictest17788-21irqstats01:35:361
7459992611,11cyclictest0-21swapper/100:00:241
7453992621,3cyclictest9-21ksoftirqd/000:15:120
7453992620,3cyclictest9-21ksoftirqd/022:50:090
7453992620,3cyclictest9-21ksoftirqd/002:55:300
7453992620,3cyclictest9-21ksoftirqd/001:10:350
7453992619,4cyclictest9-21ksoftirqd/022:31:240
6672260,21sleep00-21swapper/000:05:180
151891260,1ptp4l401ktimersoftd/303:33:223
7474992518,4cyclictest41-21ksoftirqd/323:31:133
7465992520,3cyclictest33-21ksoftirqd/223:41:022
7465992519,3cyclictest33-21ksoftirqd/223:59:462
7465992519,3cyclictest33-21ksoftirqd/222:41:022
7465992518,4cyclictest7168-21grep02:00:292
7465992518,4cyclictest33-21ksoftirqd/223:06:512
7465992518,4cyclictest33-21ksoftirqd/223:06:512
7465992518,4cyclictest33-21ksoftirqd/222:09:542
7465992518,4cyclictest33-21ksoftirqd/203:23:342
7459992513,8cyclictest981-21mailstats22:55:341
7459992513,8cyclictest30235-21irqrtprio02:25:341
7459992513,8cyclictest2543-21sed23:00:281
7459992512,10cyclictest10357-21munin-node22:10:121
7459992511,10cyclictest0-21swapper/123:50:231
7453992520,3cyclictest9-21ksoftirqd/022:40:320
7453992520,3cyclictest9-21ksoftirqd/002:30:380
7453992520,3cyclictest9-21ksoftirqd/000:55:450
7453992519,4cyclictest9-21ksoftirqd/002:24:360
7453992519,3cyclictest9-21ksoftirqd/001:40:330
7453992518,4cyclictest9-21ksoftirqd/023:19:460
7453992518,4cyclictest9-21ksoftirqd/023:05:490
7453992518,4cyclictest9-21ksoftirqd/023:05:490
7453992518,4cyclictest9-21ksoftirqd/022:25:580
7453992513,6cyclictest9-21ksoftirqd/001:20:250
289012250,3sleep0745399cyclictest01:48:210
199852250,2sleep20-21swapper/202:15:052
7465992418,3cyclictest33-21ksoftirqd/202:59:332
7465992417,4cyclictest33-21ksoftirqd/223:11:212
7465992417,4cyclictest33-21ksoftirqd/201:01:012
7465992416,4cyclictest33-21ksoftirqd/202:20:252
7465992410,10cyclictest28372-21memory22:45:312
746599240,21cyclictest1442-21cat00:05:302
7459992413,8cyclictest25500-21gltestperf22:40:291
7459992412,9cyclictest4564-21tr23:05:241
7459992412,9cyclictest4564-21tr23:05:241
7459992412,8cyclictest20426-21grep22:30:231
7453992419,3cyclictest9-21ksoftirqd/023:30:300
7453992419,3cyclictest9-21ksoftirqd/022:40:090
7453992419,3cyclictest9-21ksoftirqd/022:15:260
7453992419,3cyclictest9-21ksoftirqd/002:05:320
7453992419,3cyclictest9-21ksoftirqd/000:20:110
7453992418,3cyclictest9-21ksoftirqd/023:10:290
7453992418,3cyclictest9-21ksoftirqd/022:20:290
7453992417,4cyclictest9-21ksoftirqd/023:00:230
151891240,1ptp4l401ktimersoftd/323:15:263
151891240,1ptp4l401ktimersoftd/323:10:343
151891240,1ptp4l401ktimersoftd/322:35:333
151891240,1ptp4l401ktimersoftd/322:25:283
151891240,1ptp4l401ktimersoftd/301:30:303
151891240,1ptp4l401ktimersoftd/300:15:413
746599234,4cyclictest121rcu_preempt23:40:112
7465992318,3cyclictest31846-21awk22:55:092
7465992317,4cyclictest33-21ksoftirqd/201:48:352
7465992317,4cyclictest33-21ksoftirqd/200:37:572
7465992317,3cyclictest33-21ksoftirqd/203:30:362
7465992317,3cyclictest33-21ksoftirqd/201:15:142
7465992317,3cyclictest33-21ksoftirqd/200:03:182
746599231,3cyclictest121rcu_preempt00:32:572
7459992317,3cyclictest25-21ksoftirqd/123:40:241
745399233,12cyclictest4472-21ssh00:45:280
745399233,11cyclictest63-21kswapd001:55:250
745399232,12cyclictest358-21diskmemload01:05:260
7453992318,3cyclictest9-21ksoftirqd/000:40:280
7453992317,4cyclictest9-21ksoftirqd/000:50:350
7453992317,4cyclictest9-21ksoftirqd/000:50:350
7453992317,3cyclictest9-21ksoftirqd/003:20:360
7453992314,7cyclictest9-21ksoftirqd/000:05:120
7453992312,6cyclictest9-21ksoftirqd/001:50:270
7465992217,3cyclictest33-21ksoftirqd/201:40:392
7465992216,3cyclictest33-21ksoftirqd/223:45:222
7465992216,3cyclictest33-21ksoftirqd/200:15:402
7465992215,4cyclictest7176-21sh03:13:022
7453992215,4cyclictest9-21ksoftirqd/000:00:050
306872220,2sleep2746599cyclictest03:01:582
7465992116,3cyclictest33-21ksoftirqd/201:55:322
7465992116,3cyclictest33-21ksoftirqd/201:51:552
7465992115,3cyclictest33-21ksoftirqd/203:08:112
7465992114,4cyclictest12918-21sh02:41:562
7465992110,8cyclictest17365-21ssh00:59:522
7453992116,3cyclictest9-21ksoftirqd/023:20:260
7453992116,3cyclictest9-21ksoftirqd/022:50:320
7453992115,3cyclictest9-21ksoftirqd/023:25:510
7453992115,3cyclictest9-21ksoftirqd/003:15:340
7453992114,4cyclictest9-21ksoftirqd/002:44:500
7453992113,5cyclictest20092-21idleruntime-cro02:15:140
7465992014,3cyclictest10730-21timerwakeupswit23:15:422
7465992013,4cyclictest5971-21basename02:35:252
7465992013,4cyclictest5971-21basename02:35:252
7465992013,4cyclictest358-21diskmemload02:47:012
7465992013,4cyclictest358-21diskmemload01:09:082
7453992016,3cyclictest9-21ksoftirqd/001:15:270
7453992015,3cyclictest9-21ksoftirqd/000:30:390
7453992014,3cyclictest19850-21cut02:50:320
745399201,16cyclictest1397-21tr03:05:370
746599191,5cyclictest15297-21snmp_o5powerctl23:25:352
7465991913,3cyclictest21688-21sh00:27:282
7465991912,4cyclictest31231-21unixbench_singl02:25:452
746599191,15cyclictest23031-21grep22:35:292
746599190,17cyclictest0-21swapper/203:25:372
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional