You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 02:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Apr 19, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
723021460,2sleep20-21swapper/211:41:132
2697421220,4sleep326978-21diskmemload13:28:503
1791911070,4ptp4l401ktimersoftd/309:23:113
179191730,1ptp4l401ktimersoftd/314:32:483
179191670,1ptp4l401ktimersoftd/313:35:543
130432630,3sleep2321ktimersoftd/212:32:042
297812620,3sleep30-21swapper/311:28:453
63882570,3sleep2311rcuc/214:23:412
3191599568,18cyclictest1811-21ssh13:38:321
326772540,1sleep10-21swapper/113:35:581
3191599546,17cyclictest24251-21latency_hist10:13:241
3191599538,17cyclictest17111-21/usr/sbin/munin13:18:581
3191599537,18cyclictest2164-21awk12:58:421
3191599536,16cyclictest9847-21acpi09:43:331
3191599536,15cyclictest7282-21phc2sys10:43:471
316052533,36sleep20-21swapper/209:20:452
268862530,2sleep30-21swapper/314:48:473
268862530,2sleep30-21swapper/314:48:473
255952530,1sleep20-21swapper/213:28:372
20222530,2sleep00-21swapper/012:14:230
3191599527,16cyclictest24823-21diskmemload13:26:511
179191510,2ptp4l26160-21kworker/3:112:00:073
3191599506,11cyclictest18463-21timerandwakeup09:58:541
3191599503,16cyclictest0-21swapper/110:33:531
3191599495,12cyclictest14765-21basename13:13:551
3191599493,11cyclictest0-21swapper/112:07:591
3191599478,9cyclictest24823-21diskmemload14:25:591
3191599476,15cyclictest10015-21snmp_o5powerctl11:43:541
3191599474,10cyclictest15904-21ssh11:53:071
3191599473,17cyclictest0-21swapper/111:40:151
311132474,26sleep031192-21/usr/sbin/munin09:18:540
3191599465,17cyclictest1739-21ssh14:17:471
3191599456,21cyclictest26100-21bc12:48:381
3191599442,10cyclictest0-21swapper/111:38:101
179191440,1ptp4l401ktimersoftd/313:48:123
179191430,17ptp4l401ktimersoftd/312:44:013
179191410,1ptp4l401ktimersoftd/312:08:433
179191400,1ptp4l401ktimersoftd/313:21:323
179191390,1ptp4l401ktimersoftd/314:14:013
179191390,1ptp4l401ktimersoftd/314:05:513
179191390,1ptp4l401ktimersoftd/314:01:353
179191390,1ptp4l401ktimersoftd/313:04:223
179191390,1ptp4l401ktimersoftd/313:04:223
179191390,1ptp4l401ktimersoftd/311:51:463
179191390,1ptp4l401ktimersoftd/311:42:013
179191380,1ptp4l401ktimersoftd/314:45:043
179191380,1ptp4l401ktimersoftd/314:23:303
179191380,1ptp4l401ktimersoftd/312:51:553
179191380,1ptp4l401ktimersoftd/312:39:193
179191380,1ptp4l401ktimersoftd/311:46:513
179191380,1ptp4l401ktimersoftd/311:18:353
179191380,1ptp4l401ktimersoftd/311:18:353
179191380,1ptp4l401ktimersoftd/310:53:403
179191380,1ptp4l401ktimersoftd/310:43:443
179191370,1ptp4l401ktimersoftd/313:49:463
179191370,1ptp4l401ktimersoftd/313:13:003
179191370,0ptp4l401ktimersoftd/314:18:453
179191370,0ptp4l401ktimersoftd/312:55:133
3191599368,13cyclictest29117-21sed12:08:441
179191360,1ptp4l401ktimersoftd/314:09:023
3191599354,12cyclictest0-21swapper/111:53:341
200872350,4sleep23192099cyclictest14:39:032
179191350,2ptp4l26160-21kworker/3:113:02:583
179191350,1ptp4l401ktimersoftd/311:28:073
158232350,2sleep00-21swapper/009:53:440
3191599348,9cyclictest23764-21snmp_o5powerctl14:44:001
3191599347,12cyclictest21760-21switchtime11:13:551
3191599344,11cyclictest0-21swapper/110:48:421
31915993415,14cyclictest0-21swapper/113:53:391
179191340,1ptp4l401ktimersoftd/311:56:383
179191340,1ptp4l401ktimersoftd/309:53:413
179191340,0ptp4l401ktimersoftd/313:27:373
3191599337,14cyclictest6812-21/usr/sbin/munin13:03:501
3191599337,14cyclictest6812-21/usr/sbin/munin13:03:501
3191599335,17cyclictest12939-21ssh14:31:071
31915993321,6cyclictest29087-21apt-get11:28:371
31915993316,12cyclictest0-21swapper/112:38:401
31915993312,18cyclictest5248-21wc10:38:571
179191330,2ptp4l26160-21kworker/3:113:39:053
179191330,2ptp4l26160-21kworker/3:112:32:343
179191330,1ptp4l401ktimersoftd/314:40:113
179191330,1ptp4l401ktimersoftd/314:37:443
179191330,1ptp4l401ktimersoftd/313:58:093
179191330,1ptp4l401ktimersoftd/313:15:493
179191330,1ptp4l401ktimersoftd/310:18:523
179191330,1ptp4l401ktimersoftd/310:03:483
179191330,10ptp4l401ktimersoftd/312:24:343
3191599328,8cyclictest20244-21snmp_o5powerctl13:59:001
3191599326,13cyclictest24823-21diskmemload11:58:401
3191599325,13cyclictest24823-21diskmemload12:46:431
31910993225,4cyclictest9-21ksoftirqd/013:33:280
179191320,1ptp4l401ktimersoftd/312:19:483
179191320,1ptp4l401ktimersoftd/312:14:413
179191320,1ptp4l401ktimersoftd/309:38:513
179191320,0ptp4l401ktimersoftd/311:12:513
3191599313,17cyclictest0-21swapper/114:06:391
179191310,1ptp4l401ktimersoftd/310:42:313
31925993023,4cyclictest41-21ksoftirqd/311:33:443
31925993022,4cyclictest41-21ksoftirqd/310:03:233
3191599302,19cyclictest0-21swapper/109:27:141
3191599302,19cyclictest0-21swapper/109:27:141
3191599302,10cyclictest0-21swapper/112:53:561
31910993025,3cyclictest9-21ksoftirqd/009:28:230
31910993025,3cyclictest9-21ksoftirqd/009:28:230
31910993024,3cyclictest9-21ksoftirqd/013:38:290
179191300,1ptp4l401ktimersoftd/310:29:443
179191300,1ptp4l401ktimersoftd/309:53:113
179191300,0ptp4l401ktimersoftd/310:59:363
31915992911,15cyclictest24867-21sed11:23:251
31915992911,15cyclictest24867-21sed11:23:251
31910992922,4cyclictest9-21ksoftirqd/010:51:130
179191290,1ptp4l401ktimersoftd/309:35:473
31925992822,3cyclictest41-21ksoftirqd/312:05:153
31925992821,4cyclictest41-21ksoftirqd/311:14:283
31925992821,4cyclictest41-21ksoftirqd/309:25:163
31925992821,4cyclictest41-21ksoftirqd/309:25:163
31920992821,4cyclictest33-21ksoftirqd/214:49:472
31920992821,4cyclictest33-21ksoftirqd/214:49:472
31920992815,6cyclictest321ktimersoftd/213:33:422
3191599289,15cyclictest0-21swapper/114:38:401
3191599283,10cyclictest0-21swapper/109:48:571
3191599282,12cyclictest0-21swapper/113:30:221
31915992814,10cyclictest0-21swapper/113:48:401
31915992813,11cyclictest0-21swapper/112:18:381
31915992812,11cyclictest0-21swapper/110:58:381
31915992811,7cyclictest27229-21sed14:48:491
31915992811,7cyclictest27229-21sed14:48:491
31910992823,3cyclictest9-21ksoftirqd/013:53:290
31910992822,4cyclictest9-21ksoftirqd/012:33:260
31910992822,3cyclictest9-21ksoftirqd/011:33:250
31910992821,4cyclictest9-21ksoftirqd/010:28:240
311932285,11sleep10-21swapper/109:18:551
179191280,1ptp4l401ktimersoftd/311:07:123
31925992722,3cyclictest41-21ksoftirqd/310:38:253
31925992721,3cyclictest41-21ksoftirqd/310:16:163
31920992720,4cyclictest33-21ksoftirqd/210:10:202
31920992720,4cyclictest33-21ksoftirqd/210:05:462
3191599279,14cyclictest15533-21irqstats09:53:411
31915992722,3cyclictest25-21ksoftirqd/112:31:101
3191599272,10cyclictest0-21swapper/112:38:261
3191599272,10cyclictest0-21swapper/111:25:331
31915992714,9cyclictest0-21swapper/113:08:381
3191599271,11cyclictest0-21swapper/114:21:251
31915992711,11cyclictest0-21swapper/109:33:361
3191599271,10cyclictest0-21swapper/112:16:551
31910992722,3cyclictest9-21ksoftirqd/011:13:250
31910992721,4cyclictest9-21ksoftirqd/009:28:390
31910992721,4cyclictest9-21ksoftirqd/009:28:390
31910992721,3cyclictest9-21ksoftirqd/013:14:040
31910992720,4cyclictest9-21ksoftirqd/014:24:520
31910992720,4cyclictest9-21ksoftirqd/013:56:250
179191270,1ptp4l401ktimersoftd/309:29:333
179191270,1ptp4l401ktimersoftd/309:29:333
31920992621,3cyclictest33-21ksoftirqd/212:23:402
31920992620,4cyclictest33-21ksoftirqd/211:28:462
31920992620,3cyclictest33-21ksoftirqd/214:30:322
31920992620,3cyclictest33-21ksoftirqd/212:02:452
31920992620,3cyclictest33-21ksoftirqd/210:16:582
31920992619,4cyclictest33-21ksoftirqd/213:41:132
31920992619,4cyclictest33-21ksoftirqd/209:40:292
31920992619,4cyclictest33-21ksoftirqd/209:35:072
31920992619,4cyclictest33-21ksoftirqd/209:32:102
31920992619,4cyclictest33-21ksoftirqd/209:32:102
31915992621,3cyclictest25-21ksoftirqd/110:18:381
3191599262,10cyclictest0-21swapper/113:44:491
31915992614,9cyclictest217-21systemd-journal10:33:241
31910992621,3cyclictest9-21ksoftirqd/014:28:490
31910992621,3cyclictest9-21ksoftirqd/011:18:440
31910992621,3cyclictest9-21ksoftirqd/011:18:440
31910992621,3cyclictest9-21ksoftirqd/009:38:140
31910992620,3cyclictest9-21ksoftirqd/014:46:580
31910992620,3cyclictest9-21ksoftirqd/013:23:580
31910992620,3cyclictest9-21ksoftirqd/013:12:250
31910992620,3cyclictest9-21ksoftirqd/011:43:260
31910992620,3cyclictest9-21ksoftirqd/010:05:360
31910992619,4cyclictest9-21ksoftirqd/009:51:230
179191260,1ptp4l26160-21kworker/3:112:33:413
31920992519,4cyclictest33-21ksoftirqd/212:55:492
31920992518,4cyclictest33-21ksoftirqd/211:09:252
31915992520,3cyclictest25-21ksoftirqd/111:03:511
3191599251,9cyclictest0-21swapper/114:37:581
3191599251,9cyclictest0-21swapper/112:28:111
31915992514,8cyclictest29199-21tr10:23:371
31915992514,8cyclictest11310-21grep10:53:411
31915992514,7cyclictest25693-21snmp_o5powerctl10:13:541
31915992514,7cyclictest19359-21snmp_o5powerctl11:08:551
31915992513,8cyclictest7666-21grep09:38:341
31915992513,8cyclictest20947-21snmp_o5powerctl10:03:541
31910992520,3cyclictest9-21ksoftirqd/014:03:580
31910992520,3cyclictest9-21ksoftirqd/013:58:480
31910992520,3cyclictest9-21ksoftirqd/012:03:430
31910992520,3cyclictest9-21ksoftirqd/010:33:480
31910992518,4cyclictest9-21ksoftirqd/013:05:500
31910992518,4cyclictest9-21ksoftirqd/013:05:500
31910992518,4cyclictest9-21ksoftirqd/012:51:530
31910992518,4cyclictest9-21ksoftirqd/012:44:340
226062250,3sleep23192099cyclictest14:03:302
179191250,1ptp4l401ktimersoftd/310:26:393
179191250,1ptp4l401ktimersoftd/310:08:353
179191250,1ptp4l401ktimersoftd/309:43:313
31920992418,4cyclictest33-21ksoftirqd/209:53:022
31920992418,3cyclictest33-21ksoftirqd/211:46:012
31920992418,3cyclictest33-21ksoftirqd/210:20:322
31920992417,4cyclictest33-21ksoftirqd/213:52:052
31920992417,4cyclictest33-21ksoftirqd/210:37:462
31920992417,4cyclictest33-21ksoftirqd/210:30:032
31920992413,8cyclictest6862-21sh12:21:532
31915992413,8cyclictest26830-21ssh14:08:421
31915992413,7cyclictest2296-21fschecks_count09:28:251
31915992413,7cyclictest2296-21fschecks_count09:28:251
31910992418,3cyclictest9-21ksoftirqd/012:55:510
31910992418,3cyclictest9-21ksoftirqd/012:38:550
31910992418,3cyclictest9-21ksoftirqd/011:07:310
31910992418,3cyclictest9-21ksoftirqd/010:15:040
31910992418,3cyclictest9-21ksoftirqd/009:42:570
31910992418,3cyclictest8223-21turbostat10:48:240
31910992417,4cyclictest9-21ksoftirqd/011:02:290
31910992416,5cyclictest9-21ksoftirqd/010:38:450
31910992415,5cyclictest46850irq/98-ens3-TxR14:08:430
179191240,0ptp4l401ktimersoftd/310:48:453
3192099239,11cyclictest26407-21fschecks_count12:48:432
31920992318,3cyclictest33-21ksoftirqd/213:03:492
31920992318,3cyclictest33-21ksoftirqd/213:03:492
31920992317,4cyclictest33-21ksoftirqd/210:39:102
31920992317,3cyclictest33-21ksoftirqd/209:46:312
31920992316,4cyclictest33-21ksoftirqd/211:49:322
31920992316,4cyclictest33-21ksoftirqd/209:25:402
31920992316,4cyclictest33-21ksoftirqd/209:25:402
31910992318,3cyclictest9-21ksoftirqd/014:42:110
31910992318,3cyclictest9-21ksoftirqd/012:08:410
31910992317,4cyclictest9-21ksoftirqd/014:48:420
31910992317,4cyclictest9-21ksoftirqd/014:48:420
31910992317,3cyclictest9-21ksoftirqd/013:18:380
31910992317,3cyclictest9-21ksoftirqd/011:26:460
31910992316,4cyclictest9-21ksoftirqd/013:00:360
31910992316,4cyclictest9-21ksoftirqd/010:20:500
31910992316,4cyclictest9-21ksoftirqd/009:45:370
3192099225,2cyclictest121rcu_preempt12:08:392
3192099222,17cyclictest10785-21grep13:08:502
31920992216,3cyclictest33-21ksoftirqd/211:02:122
31920992216,3cyclictest33-21ksoftirqd/210:25:212
31920992215,4cyclictest33-21ksoftirqd/212:16:102
31920992215,4cyclictest33-21ksoftirqd/210:54:482
31920992215,4cyclictest33-21ksoftirqd/209:58:032
31910992217,3cyclictest9-21ksoftirqd/011:33:410
31910992216,3cyclictest9-21ksoftirqd/014:23:050
31910992216,3cyclictest9-21ksoftirqd/011:53:580
31910992216,3cyclictest9-21ksoftirqd/010:30:240
31910992215,4cyclictest9-21ksoftirqd/011:49:020
31910992215,4cyclictest9-21ksoftirqd/010:53:340
31910992215,4cyclictest31891-21missed_timers14:13:500
31920992116,3cyclictest33-21ksoftirqd/214:07:432
31920992114,4cyclictest785-21sh14:15:242
31920992114,4cyclictest33-21ksoftirqd/211:20:012
31920992114,4cyclictest33-21ksoftirqd/211:20:012
31920992114,4cyclictest27114-21sh11:24:342
31920992114,4cyclictest23154-21cut14:43:482
31920992114,4cyclictest18807-21sh11:55:122
31920992110,9cyclictest22456-21cron11:18:252
31910992115,3cyclictest9-21ksoftirqd/013:44:580
31910992115,3cyclictest9-21ksoftirqd/011:43:390
31910992115,3cyclictest16368-21sh14:34:450
31910992114,4cyclictest20563-21cat11:13:390
31910992114,4cyclictest1852-21/usr/sbin/munin13:38:420
31910992114,4cyclictest14675-21hddtemp_smartct12:33:400
31920992015,3cyclictest33-21ksoftirqd/213:25:212
31920992014,4cyclictest33-21ksoftirqd/209:59:282
31920992014,3cyclictest7048-21kernelversion10:43:442
31920992014,3cyclictest33-21ksoftirqd/214:18:582
31920992014,3cyclictest28891-21sh14:09:402
31920992014,3cyclictest24194-21sh12:44:442
31920992014,3cyclictest17156-21sh14:36:392
31920992013,4cyclictest9040-21sh13:46:312
31920992013,4cyclictest3381-21sh11:36:082
31920992013,4cyclictest16351-21sh12:34:502
31920992013,4cyclictest10301-21seq10:49:522
31910992014,4cyclictest9-21ksoftirqd/012:18:360
31910992013,4cyclictest23503-21ssh12:02:180
31910992013,4cyclictest23175-21ptp4l10:08:460
3192099191,4cyclictest18625-21snmp_o5powerctl13:18:532
31920991913,4cyclictest27083-21sh12:06:102
31920991913,4cyclictest16943-21mailstats11:03:512
31920991913,3cyclictest18346-21sh12:38:412
31920991913,3cyclictest13267-21sh13:13:322
31920991912,4cyclictest1896-21fschecks_count12:58:402
31920991912,4cyclictest16982-21sh13:55:032
31910991914,3cyclictest17020-21dpkg09:58:330
31910991913,3cyclictest9-21ksoftirqd/012:24:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional