You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 05:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Mon May 05, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1518911420,5ptp4l401ktimersoftd/321:24:563
194112674,10sleep10-21swapper/121:24:051
232592640,2sleep00-21swapper/021:32:480
71622600,2sleep30-21swapper/301:44:523
193952574,41sleep00-21swapper/021:23:520
145512560,3sleep21980299cyclictest01:17:412
250062550,2sleep30-21swapper/300:17:353
293072530,5sleep01978899cyclictest21:43:040
1979499537,9cyclictest25-21ksoftirqd/101:23:081
292372520,2sleep10-21swapper/122:52:501
189812510,1sleep30-21swapper/300:09:323
1979499506,9cyclictest16696-21ssh02:32:531
1979499504,6cyclictest25-21ksoftirqd/100:27:381
19802994938,6cyclictest33-21ksoftirqd/202:02:542
1979499497,9cyclictest25-21ksoftirqd/100:52:541
1979499497,9cyclictest25-21ksoftirqd/100:32:541
1979499496,9cyclictest25-21ksoftirqd/123:54:461
1979499490,45cyclictest241ktimersoftd/123:42:561
1979499490,45cyclictest241ktimersoftd/123:42:561
1979499487,9cyclictest25-21ksoftirqd/123:38:081
1979499487,5cyclictest22552-21snmp_o5powerctl02:38:061
1979499486,9cyclictest25-21ksoftirqd/122:48:021
1979499486,9cyclictest25-21ksoftirqd/122:07:521
1979499486,8cyclictest25-21ksoftirqd/100:12:371
1979499485,9cyclictest25-21ksoftirqd/101:53:081
1979499485,4cyclictest25-21ksoftirqd/123:12:581
1979499485,10cyclictest25-21ksoftirqd/122:22:541
1979499483,7cyclictest9929-21ssh01:47:591
1978899485,9cyclictest9-21ksoftirqd/023:44:430
1978899485,9cyclictest9-21ksoftirqd/023:44:430
1979499477,9cyclictest25-21ksoftirqd/123:48:001
1979499476,9cyclictest25-21ksoftirqd/102:46:411
1979499476,9cyclictest25-21ksoftirqd/101:03:021
1979499476,8cyclictest25-21ksoftirqd/121:28:031
1979499474,10cyclictest25-21ksoftirqd/101:57:571
1978899474,10cyclictest9-21ksoftirqd/000:50:150
1978899472,7cyclictest9-21ksoftirqd/001:38:020
1979499467,9cyclictest25-21ksoftirqd/123:22:351
1979499467,9cyclictest25-21ksoftirqd/101:27:541
1979499467,9cyclictest25-21ksoftirqd/101:27:541
1979499467,8cyclictest25-21ksoftirqd/121:47:331
1979499467,8cyclictest25-21ksoftirqd/100:03:011
1979499467,11cyclictest25-21ksoftirqd/102:23:281
1979499466,9cyclictest25-21ksoftirqd/100:49:331
1979499466,8cyclictest25-21ksoftirqd/123:58:231
1979499466,8cyclictest25-21ksoftirqd/122:42:531
1979499466,10cyclictest25-21ksoftirqd/123:02:491
1979499466,10cyclictest25-21ksoftirqd/122:32:551
1979499466,10cyclictest25-21ksoftirqd/121:52:491
1979499464,10cyclictest25-21ksoftirqd/122:12:551
1979499463,6cyclictest25-21ksoftirqd/102:48:131
1978899466,7cyclictest9-21ksoftirqd/000:54:080
1978899463,7cyclictest9-21ksoftirqd/002:20:260
1978899463,7cyclictest9-21ksoftirqd/002:15:420
1978899463,7cyclictest9-21ksoftirqd/000:01:480
1978899463,6cyclictest13786-21ssh00:03:070
1978899462,8cyclictest101ktimersoftd/023:38:010
1978899462,7cyclictest9-21ksoftirqd/002:08:390
1978899462,6cyclictest9-21ksoftirqd/002:37:070
1978899461,9cyclictest32115-21/usr/sbin/munin23:48:000
1978899461,8cyclictest31424-21grep21:47:580
1978899461,6cyclictest9-21ksoftirqd/002:41:300
1978899460,43cyclictest101ktimersoftd/023:33:070
1979499456,9cyclictest25-21ksoftirqd/100:19:571
1979499456,8cyclictest25-21ksoftirqd/101:10:341
1979499455,9cyclictest25-21ksoftirqd/101:42:501
1979499455,9cyclictest25-21ksoftirqd/101:32:491
1979499455,10cyclictest25-21ksoftirqd/102:09:381
1979499454,9cyclictest25-21ksoftirqd/123:34:001
1979499454,9cyclictest25-21ksoftirqd/100:38:251
1979499454,6cyclictest25-21ksoftirqd/100:12:371
19794994540,3cyclictest231rcuc/101:14:041
1979499453,8cyclictest25-21ksoftirqd/102:27:411
1979499453,7cyclictest25-21ksoftirqd/100:57:561
1979499453,6cyclictest25-21ksoftirqd/101:37:581
1979499452,7cyclictest25-21ksoftirqd/102:02:591
1979499451,7cyclictest25-21ksoftirqd/121:37:521
1978899454,9cyclictest9-21ksoftirqd/002:52:570
1978899454,9cyclictest9-21ksoftirqd/000:33:090
1978899453,7cyclictest9-21ksoftirqd/022:18:030
1978899453,7cyclictest9-21ksoftirqd/022:02:590
1978899453,7cyclictest9-21ksoftirqd/002:50:190
1978899453,7cyclictest9-21ksoftirqd/000:39:340
1978899453,6cyclictest9-21ksoftirqd/023:53:190
1978899453,6cyclictest9-21ksoftirqd/001:54:310
1978899453,6cyclictest9-21ksoftirqd/001:31:580
1978899453,6cyclictest9-21ksoftirqd/001:31:580
1978899453,6cyclictest9-21ksoftirqd/000:25:200
1978899453,6cyclictest13497-21ssh02:28:020
1978899453,6cyclictest101ktimersoftd/001:48:050
1978899452,7cyclictest9-21ksoftirqd/000:29:080
1978899452,6cyclictest9-21ksoftirqd/001:58:020
1978899451,8cyclictest9114-21grep02:23:080
155122450,1sleep20-21swapper/200:06:342
1979499446,9cyclictest25-21ksoftirqd/123:07:511
1979499446,9cyclictest25-21ksoftirqd/122:17:481
1979499445,9cyclictest25-21ksoftirqd/123:27:461
1979499445,9cyclictest25-21ksoftirqd/102:53:511
1979499445,8cyclictest7428-21ssh02:22:401
1979499445,8cyclictest25-21ksoftirqd/102:13:101
1979499444,9cyclictest25-21ksoftirqd/101:18:551
1979499444,7cyclictest25-21ksoftirqd/122:28:071
1979499444,7cyclictest25-21ksoftirqd/100:42:551
1979499444,10cyclictest25-21ksoftirqd/121:47:511
1979499443,6cyclictest25-21ksoftirqd/122:38:061
1978899445,9cyclictest9-21ksoftirqd/022:27:490
1978899445,9cyclictest9-21ksoftirqd/000:47:160
1978899445,4cyclictest9-21ksoftirqd/022:32:590
1978899443,6cyclictest9-21ksoftirqd/023:29:350
1978899443,6cyclictest9-21ksoftirqd/021:29:170
1978899443,6cyclictest9-21ksoftirqd/002:43:410
1978899443,6cyclictest9-21ksoftirqd/001:25:500
1978899443,6cyclictest9-21ksoftirqd/001:20:580
1978899443,6cyclictest101ktimersoftd/022:42:500
1978899443,10cyclictest9-21ksoftirqd/001:33:240
1978899442,7cyclictest9-21ksoftirqd/000:08:450
1978899442,6cyclictest9-21ksoftirqd/002:06:150
1978899442,6cyclictest9-21ksoftirqd/000:57:510
1978899441,7cyclictest101ktimersoftd/001:43:010
1978899440,8cyclictest9-21ksoftirqd/001:02:520
1979499435,8cyclictest25-21ksoftirqd/121:32:361
1979499433,7cyclictest25-21ksoftirqd/122:02:591
1979499432,7cyclictest25-21ksoftirqd/100:30:241
1978899433,7cyclictest9-21ksoftirqd/022:16:320
1978899432,7cyclictest9-21ksoftirqd/001:09:580
1978899432,6cyclictest9-21ksoftirqd/023:18:020
1978899432,6cyclictest9-21ksoftirqd/023:07:590
1978899432,6cyclictest9-21ksoftirqd/021:58:020
1978899432,6cyclictest9-21ksoftirqd/021:58:020
1978899432,6cyclictest9-21ksoftirqd/001:13:350
1978899432,6cyclictest9-21ksoftirqd/000:15:200
1978899431,7cyclictest9-21ksoftirqd/000:20:130
1978899431,6cyclictest9-21ksoftirqd/023:05:200
1978899423,6cyclictest9-21ksoftirqd/021:54:000
1978899422,6cyclictest9-21ksoftirqd/023:23:000
1978899420,8cyclictest101ktimersoftd/022:37:500
1978899420,7cyclictest101ktimersoftd/022:23:040
1979499413,6cyclictest25-21ksoftirqd/121:57:521
1979499413,6cyclictest25-21ksoftirqd/121:57:521
1978899416,9cyclictest9-21ksoftirqd/021:37:540
1978899412,6cyclictest9-21ksoftirqd/022:47:390
1959924118,11sleep233-21ksoftirqd/221:26:332
19808994017,20cyclictest28439-21grep01:32:553
1980899401,33cyclictest0-21swapper/301:07:523
1979499406,9cyclictest25-21ksoftirqd/123:22:541
1978899405,6cyclictest9-21ksoftirqd/022:52:500
1978899402,6cyclictest9-21ksoftirqd/023:13:080
1978899402,6cyclictest9-21ksoftirqd/022:57:490
1978899401,7cyclictest9-21ksoftirqd/022:09:420
1979499392,6cyclictest25-21ksoftirqd/122:57:511
151891380,1ptp4l401ktimersoftd/300:24:153
151891380,1ptp4l401ktimersoftd/300:00:173
151891380,0ptp4l401ktimersoftd/323:52:233
1980899373,28cyclictest0-21swapper/323:37:513
1980899371,30cyclictest0-21swapper/301:02:553
151891370,1ptp4l401ktimersoftd/302:41:493
1980899360,5cyclictest0-21swapper/322:37:523
1980899360,4cyclictest7985-21grep00:33:033
1980899360,4cyclictest18556-21sed23:32:573
19802993621,7cyclictest33-21ksoftirqd/200:22:492
151891360,1ptp4l401ktimersoftd/322:53:053
151891360,1ptp4l401ktimersoftd/301:02:193
151891360,1ptp4l401ktimersoftd/300:57:153
151891360,1ptp4l401ktimersoftd/300:04:013
1980899353,28cyclictest13053-21latency_hist23:27:363
1980899352,6cyclictest14710-21apt-get01:17:513
1980899352,28cyclictest0-21swapper/321:37:483
19808993511,21cyclictest18128-21cut22:27:583
1980899350,4cyclictest26538-21dpkg23:42:493
1980899350,4cyclictest26538-21dpkg23:42:493
1980899350,4cyclictest11147-21missed_timers01:13:043
1980899350,3cyclictest23778-21mailstats02:03:053
1980899349,22cyclictest29937-21grep02:47:593
1980899342,27cyclictest0-21swapper/302:42:533
19808993413,18cyclictest4621-21ptp4l02:18:043
1980899341,27cyclictest0-21swapper/323:17:533
1980899341,26cyclictest26639-21apt-get22:47:523
19808993412,18cyclictest19490-21basename22:32:513
19808993410,21cyclictest24738-21awk21:33:043
19808993410,21cyclictest14403-21cat01:52:593
19808993410,20cyclictest14589-21cat22:22:353
1980899340,4cyclictest18731-21ssh02:33:493
1980899340,4cyclictest1550-21snmp_o5powerctl01:38:083
1980899340,4cyclictest13454-21ssh00:39:033
1980899340,4cyclictest12858-21ps22:17:553
1980899340,3cyclictest27889-21ssh00:19:223
19802993419,8cyclictest33-21ksoftirqd/202:27:532
1980899339,21cyclictest32672-21basename02:13:043
1980899339,21cyclictest24410-21expr22:42:523
1980899339,21cyclictest13594-21fschecks_count23:27:523
1980899330,4cyclictest29984-21ssh02:10:533
1980899330,3cyclictest14512-21ssh02:28:493
19802993319,8cyclictest33-21ksoftirqd/223:02:492
1980899328,21cyclictest6873-21seq22:06:533
1980899327,22cyclictest2313-21missed_timers23:02:573
1980899321,4cyclictest12279-21rm01:51:123
19808993210,19cyclictest1484-21switchtime21:53:023
1980899320,5cyclictest2032-21apt-get00:27:423
1980899320,4cyclictest5275-21ssh23:53:583
1980899320,3cyclictest21710-21ssh02:02:053
1980899317,21cyclictest21572-21ls00:48:063
1980899313,3cyclictest0-21swapper/323:07:483
1980899312,5cyclictest15650-21apt-get00:42:503
1980899312,25cyclictest31382-21apt-get22:57:493
19808993111,17cyclictest1994-21phc2sys02:53:013
1980899310,5cyclictest11520-21rm02:27:063
1980899310,4cyclictest29171-21snmp_o5powerctl21:43:033
19802993125,3cyclictest33-21ksoftirqd/200:37:512
19808993012,15cyclictest19558-21perl01:22:553
1980899300,4cyclictest24633-21memory01:28:003
1980899300,4cyclictest24633-21memory01:28:003
1980899300,4cyclictest20429-21/usr/sbin/munin21:27:503
19802993024,3cyclictest33-21ksoftirqd/201:43:082
1980899297,19cyclictest30839-21irqrtprio21:47:543
1980899296,3cyclictest7694-21cut22:07:513
1980899295,3cyclictest2797-21uniq21:57:493
1980899295,3cyclictest2797-21uniq21:57:493
1980899293,5cyclictest9606-21apt-get22:12:473
19802992923,3cyclictest33-21ksoftirqd/222:37:352
19802992923,3cyclictest33-21ksoftirqd/202:23:492
19802992923,3cyclictest33-21ksoftirqd/200:35:232
19802992823,3cyclictest33-21ksoftirqd/200:47:542
19802992822,4cyclictest33-21ksoftirqd/201:51:532
19802992822,3cyclictest33-21ksoftirqd/222:31:342
19802992821,4cyclictest33-21ksoftirqd/222:54:322
19802992821,4cyclictest33-21ksoftirqd/221:30:382
1980899270,8cyclictest6828-21irqrtprio23:12:583
19802992722,3cyclictest33-21ksoftirqd/202:43:042
19802992722,3cyclictest33-21ksoftirqd/201:12:552
19802992721,3cyclictest33-21ksoftirqd/223:57:532
19802992721,3cyclictest33-21ksoftirqd/201:35:392
19802992720,5cyclictest33-21ksoftirqd/202:32:512
19802992720,4cyclictest33-21ksoftirqd/223:23:512
19802992720,4cyclictest33-21ksoftirqd/221:41:052
19802992720,4cyclictest33-21ksoftirqd/201:05:282
1980299264,12cyclictest19147-21ssh01:22:512
1980299263,6cyclictest121rcu_preempt02:02:392
19802992621,3cyclictest33-21ksoftirqd/200:42:512
19802992620,4cyclictest33-21ksoftirqd/223:32:482
19802992620,3cyclictest33-21ksoftirqd/223:57:152
19802992620,3cyclictest33-21ksoftirqd/223:44:572
19802992620,3cyclictest33-21ksoftirqd/223:44:572
19802992620,3cyclictest33-21ksoftirqd/222:48:412
19802992620,3cyclictest33-21ksoftirqd/222:44:282
19802992620,3cyclictest33-21ksoftirqd/222:11:192
1980299261,22cyclictest29343-21df00:57:532
19802992519,3cyclictest33-21ksoftirqd/202:14:182
1980299251,21cyclictest4273-21uname02:18:002
19802992418,4cyclictest33-21ksoftirqd/222:40:202
19802992418,4cyclictest16526-21grep00:07:542
19802992418,3cyclictest33-21ksoftirqd/223:37:432
19802992417,4cyclictest33-21ksoftirqd/221:47:162
19802992417,4cyclictest33-21ksoftirqd/201:39:212
1980299241,4cyclictest27116-21entropy02:07:572
1980299241,20cyclictest7390-21smartctl23:13:022
19802992318,3cyclictest33-21ksoftirqd/223:52:172
19802992318,3cyclictest33-21ksoftirqd/200:54:242
19802992317,3cyclictest33-21ksoftirqd/221:56:462
19802992317,3cyclictest33-21ksoftirqd/201:53:442
19802992314,4cyclictest0-21swapper/222:57:502
19802992311,9cyclictest2733-21expr21:57:472
19802992311,9cyclictest2733-21expr21:57:472
1980299230,5cyclictest23859-21taskset02:40:142
1980299230,20cyclictest10808-21/usr/sbin/munin22:12:572
19802992217,3cyclictest33-21ksoftirqd/202:52:582
19802992217,3cyclictest33-21ksoftirqd/201:07:582
19802992217,3cyclictest33-21ksoftirqd/200:27:582
19802992216,4cyclictest10507-21awk23:22:352
19802992216,3cyclictest33-21ksoftirqd/222:21:502
1980299221,4cyclictest25841-21perl00:17:552
1980299221,18cyclictest1505-21runrttasks22:02:392
1980299220,4cyclictest3976-21fschecks_count23:07:522
19802992115,4cyclictest33-21ksoftirqd/223:28:402
1980299210,3cyclictest21036-21cpuspeed_turbos00:12:532
19802992015,3cyclictest33-21ksoftirqd/221:32:332
19802992014,3cyclictest33-21ksoftirqd/202:50:142
19802992013,4cyclictest27851-21sed01:32:392
19802992013,4cyclictest27851-21sed01:32:392
19802992013,4cyclictest15151-21perl22:22:572
19802991913,3cyclictest30673-21idleruntime21:47:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional