You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-23 - 15:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Feb 23, 2024 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
174621960,3sleep30-21swapper/320:47:423
270342830,2sleep00-21swapper/002:12:240
270342830,2sleep00-21swapper/002:12:240
47602800,4sleep0101ktimersoftd/001:42:490
13602707,47sleep10-21swapper/120:47:371
33542634,10sleep00-21swapper/020:50:340
26672600,3sleep02665-21phc2sys-jitter22:57:520
46112580,5sleep1359999cyclictest20:52:481
281672560,2sleep228170-21cut02:12:582
281672560,2sleep228170-21cut02:12:582
222712560,1sleep20-21swapper/222:37:192
179191550,1ptp4l401ktimersoftd/300:31:433
179191530,1ptp4l401ktimersoftd/323:08:163
32262504,33sleep20-21swapper/220:48:552
3593994735,7cyclictest9-21ksoftirqd/023:42:410
179191430,10ptp4l401ktimersoftd/323:00:383
134462410,4sleep0359399cyclictest23:12:380
179191400,1ptp4l401ktimersoftd/300:57:433
361299390,5cyclictest4459-21apt-get01:42:433
179191390,1ptp4l401ktimersoftd/323:40:013
179191390,1ptp4l401ktimersoftd/323:17:533
179191390,1ptp4l401ktimersoftd/300:04:483
179191380,1ptp4l401ktimersoftd/323:47:133
179191380,1ptp4l401ktimersoftd/323:27:073
179191380,1ptp4l401ktimersoftd/323:17:023
179191380,1ptp4l401ktimersoftd/320:57:533
179191380,1ptp4l401ktimersoftd/302:00:373
179191380,1ptp4l401ktimersoftd/301:14:313
179191380,1ptp4l401ktimersoftd/301:10:103
179191380,1ptp4l401ktimersoftd/300:49:463
179191380,1ptp4l401ktimersoftd/300:17:313
3599993723,4cyclictest25-21ksoftirqd/101:23:471
179191370,1ptp4l401ktimersoftd/323:35:213
179191370,1ptp4l401ktimersoftd/323:03:163
179191370,1ptp4l401ktimersoftd/302:16:513
179191370,1ptp4l401ktimersoftd/302:16:513
179191370,1ptp4l401ktimersoftd/302:11:013
179191370,1ptp4l401ktimersoftd/302:11:013
179191370,1ptp4l401ktimersoftd/301:22:563
179191370,1ptp4l401ktimersoftd/300:35:103
3612993614,19cyclictest21691-21cut21:27:413
3612993613,20cyclictest32377-21cat21:47:553
3612993612,20cyclictest4107-21expr20:52:423
361299360,5cyclictest18630-21cat22:27:513
359399365,4cyclictest121rcu_preempt01:37:460
179191360,1ptp4l401ktimersoftd/323:48:063
179191360,1ptp4l401ktimersoftd/321:07:413
179191360,1ptp4l401ktimersoftd/301:41:043
179191360,1ptp4l401ktimersoftd/300:37:393
179191360,0ptp4l401ktimersoftd/302:06:193
179191360,0ptp4l401ktimersoftd/302:06:193
179191360,0ptp4l401ktimersoftd/301:57:103
179191360,0ptp4l401ktimersoftd/300:13:313
361299352,5cyclictest0-21swapper/322:42:393
361299352,5cyclictest0-21swapper/322:42:393
361299351,7cyclictest25569-21sh23:27:433
361299351,4cyclictest8326-21apt-get01:47:483
3612993513,19cyclictest17005-21seq22:23:403
3612993511,21cyclictest30999-21basename02:17:453
361299343,9cyclictest21107-21apt-get00:42:433
361299343,5cyclictest0-21swapper/323:57:423
3612993412,19cyclictest17577-21ls01:17:533
3612993411,20cyclictest32543-21sh00:57:223
360499340,31cyclictest11326-21cron21:07:172
361299332,5cyclictest29819-21apt-get22:52:393
361299331,5cyclictest0-21swapper/321:32:393
3612993312,18cyclictest28820-21/usr/sbin/munin01:32:503
3612993312,18cyclictest28663-21expr21:42:413
3612993312,18cyclictest14433-21grep21:12:463
3612993311,19cyclictest20675-21smartctl22:32:443
3612993310,4cyclictest21206-21wc21:27:183
3612993310,3cyclictest8681-21latency_hist00:27:223
3612993310,3cyclictest8681-21latency_hist00:27:223
360499335,16cyclictest29822-21ssh22:52:392
361299329,3cyclictest26416-21cat00:07:523
361299324,8cyclictest14924-21latency_hist22:22:183
3599993218,4cyclictest25-21ksoftirqd/102:18:391
361299319,3cyclictest7818-21turbostat.cron22:07:183
361299318,4cyclictest8069-21latency_hist01:07:233
361299313,9cyclictest26073-21apt-get21:37:383
361299312,6cyclictest10504-21apt-get22:12:413
361299312,5cyclictest767-21apt-get21:52:383
361299312,4cyclictest0-21swapper/323:52:423
3612993111,17cyclictest26630-21sh01:28:303
3599993126,3cyclictest25-21ksoftirqd/101:48:031
3599993125,3cyclictest25-21ksoftirqd/123:42:211
3593993126,3cyclictest9-21ksoftirqd/023:27:550
361299305,4cyclictest50172chrt21:57:583
3599993025,3cyclictest25-21ksoftirqd/100:12:211
3599993022,5cyclictest25-21ksoftirqd/102:00:411
3593993024,3cyclictest9-21ksoftirqd/001:32:430
3593993024,3cyclictest9-21ksoftirqd/001:32:240
3593993023,4cyclictest9-21ksoftirqd/023:02:470
3593993023,4cyclictest9-21ksoftirqd/021:07:410
361299298,4cyclictest9301-21processes22:07:503
361299298,3cyclictest11438-21latency_hist21:07:173
361299297,3cyclictest28686-21grep22:47:593
3604992923,3cyclictest33-21ksoftirqd/202:12:242
3604992923,3cyclictest33-21ksoftirqd/202:12:242
3599992924,3cyclictest25-21ksoftirqd/100:32:211
3593992924,3cyclictest9-21ksoftirqd/022:22:180
3593992924,3cyclictest26971-21kworker/0:123:17:450
3593992923,4cyclictest9-21ksoftirqd/000:07:490
3593992922,4cyclictest9-21ksoftirqd/000:27:430
3604992822,3cyclictest33-21ksoftirqd/201:17:522
3604992821,4cyclictest33-21ksoftirqd/222:00:422
3599992824,3cyclictest25-21ksoftirqd/123:55:391
3599992822,3cyclictest25-21ksoftirqd/123:10:451
3599992822,3cyclictest25-21ksoftirqd/122:07:451
3599992822,3cyclictest25-21ksoftirqd/121:57:181
3599992820,5cyclictest25-21ksoftirqd/122:29:261
3599992814,4cyclictest25-21ksoftirqd/100:35:371
3593992822,3cyclictest9-21ksoftirqd/023:32:490
3593992822,3cyclictest9-21ksoftirqd/000:57:510
3593992822,3cyclictest9-21ksoftirqd/000:02:480
361299274,5cyclictest23034-21gltestperf22:37:453
3604992723,3cyclictest33-21ksoftirqd/223:12:482
3604992722,3cyclictest33-21ksoftirqd/223:42:492
3604992721,3cyclictest33-21ksoftirqd/222:13:142
3604992721,3cyclictest33-21ksoftirqd/221:34:482
3604992720,4cyclictest33-21ksoftirqd/221:40:182
3599992722,3cyclictest25-21ksoftirqd/123:42:501
3599992722,3cyclictest25-21ksoftirqd/123:17:501
3599992722,3cyclictest25-21ksoftirqd/122:42:501
3599992722,3cyclictest25-21ksoftirqd/122:42:501
3599992722,3cyclictest25-21ksoftirqd/121:02:391
3599992722,3cyclictest25-21ksoftirqd/100:12:521
3599992722,3cyclictest25-21ksoftirqd/100:06:391
3599992721,4cyclictest25-21ksoftirqd/122:19:471
3599992721,4cyclictest25-21ksoftirqd/100:39:391
3599992720,4cyclictest25-21ksoftirqd/123:24:391
3599992713,4cyclictest25-21ksoftirqd/100:49:141
3593992723,3cyclictest9-21ksoftirqd/022:37:470
3593992722,3cyclictest9-21ksoftirqd/023:47:520
3593992722,3cyclictest9-21ksoftirqd/021:57:190
3593992722,3cyclictest9-21ksoftirqd/002:06:270
3593992722,3cyclictest9-21ksoftirqd/002:06:270
3593992722,3cyclictest9-21ksoftirqd/000:13:060
3593992721,3cyclictest9-21ksoftirqd/000:37:130
3593992720,4cyclictest9-21ksoftirqd/022:47:200
3593992720,4cyclictest9-21ksoftirqd/022:31:230
3593992720,4cyclictest9-21ksoftirqd/000:17:520
204352270,4sleep2311rcuc/223:20:432
180782270,4sleep2360499cyclictest21:17:582
360499268,5cyclictest33-21ksoftirqd/201:37:462
3604992620,3cyclictest33-21ksoftirqd/222:48:312
3604992619,4cyclictest33-21ksoftirqd/221:55:122
3604992619,4cyclictest33-21ksoftirqd/201:56:482
3604992619,4cyclictest33-21ksoftirqd/201:05:542
3599992622,3cyclictest25-21ksoftirqd/122:52:461
3599992621,3cyclictest25-21ksoftirqd/123:33:061
3599992621,3cyclictest25-21ksoftirqd/121:12:491
3599992621,3cyclictest25-21ksoftirqd/101:13:021
3599992621,3cyclictest25-21ksoftirqd/100:17:481
3599992620,3cyclictest25-21ksoftirqd/121:20:331
3599992619,4cyclictest25-21ksoftirqd/123:50:091
3599992619,4cyclictest25-21ksoftirqd/123:15:001
3599992619,4cyclictest25-21ksoftirqd/121:22:271
3599992619,4cyclictest25-21ksoftirqd/102:13:381
3599992619,4cyclictest25-21ksoftirqd/102:13:381
3599992619,3cyclictest25-21ksoftirqd/101:32:431
359399264,3cyclictest121rcu_preempt01:23:470
3593992621,3cyclictest9-21ksoftirqd/023:59:440
3593992621,3cyclictest9-21ksoftirqd/023:37:480
3593992621,3cyclictest9-21ksoftirqd/022:52:500
3593992620,3cyclictest9-21ksoftirqd/023:52:490
3593992620,3cyclictest9-21ksoftirqd/021:23:210
3593992620,3cyclictest9-21ksoftirqd/021:15:390
3593992620,3cyclictest9-21ksoftirqd/001:13:230
3593992619,4cyclictest9-21ksoftirqd/022:02:200
126542260,4sleep2311rcuc/223:51:382
3604992519,3cyclictest33-21ksoftirqd/222:24:342
3604992518,4cyclictest33-21ksoftirqd/222:45:422
3604992518,4cyclictest33-21ksoftirqd/222:45:422
3604992518,4cyclictest33-21ksoftirqd/222:10:172
3604992518,4cyclictest33-21ksoftirqd/200:36:032
3599992520,3cyclictest25-21ksoftirqd/121:47:181
3599992520,3cyclictest25-21ksoftirqd/101:52:551
3599992520,3cyclictest25-21ksoftirqd/101:02:501
3599992520,3cyclictest25-21ksoftirqd/101:02:221
3599992519,4cyclictest25-21ksoftirqd/121:36:121
3599992518,4cyclictest25-21ksoftirqd/122:13:251
3599992518,4cyclictest25-21ksoftirqd/121:47:281
3593992520,3cyclictest9-21ksoftirqd/001:57:520
3593992519,3cyclictest9-21ksoftirqd/022:00:520
3593992518,4cyclictest9-21ksoftirqd/021:30:080
3593992518,3cyclictest9-21ksoftirqd/023:22:530
179191250,1ptp4l401ktimersoftd/321:17:483
3604992418,3cyclictest33-21ksoftirqd/223:04:532
3604992418,3cyclictest33-21ksoftirqd/222:41:122
3604992418,3cyclictest33-21ksoftirqd/221:46:382
3604992417,4cyclictest33-21ksoftirqd/222:31:412
3604992417,4cyclictest33-21ksoftirqd/222:03:142
3604992417,4cyclictest33-21ksoftirqd/201:08:062
3604992415,6cyclictest2125-21cut00:17:552
3599992419,3cyclictest25-21ksoftirqd/122:01:281
3599992419,3cyclictest25-21ksoftirqd/102:07:241
3599992419,3cyclictest25-21ksoftirqd/102:07:241
3599992419,3cyclictest25-21ksoftirqd/101:07:471
3599992418,3cyclictest25-21ksoftirqd/122:37:471
3599992418,3cyclictest25-21ksoftirqd/121:39:351
3599992418,3cyclictest25-21ksoftirqd/121:30:121
3599992418,3cyclictest25-21ksoftirqd/100:44:531
3599992417,4cyclictest25-21ksoftirqd/123:58:041
3599992417,4cyclictest25-21ksoftirqd/122:06:431
3593992419,3cyclictest9-21ksoftirqd/000:37:440
3593992418,3cyclictest9-21ksoftirqd/023:08:200
3593992418,3cyclictest9-21ksoftirqd/000:47:220
3593992417,4cyclictest9-21ksoftirqd/021:37:390
3593992417,4cyclictest9-21ksoftirqd/002:12:500
3593992417,4cyclictest9-21ksoftirqd/002:12:500
359399240,2cyclictest121rcu_preempt20:57:430
52252230,2sleep00-21swapper/001:02:510
360499234,11cyclictest19736-21ssh02:02:462
360499234,11cyclictest19736-21ssh02:02:462
3604992318,3cyclictest33-21ksoftirqd/200:10:172
3604992317,3cyclictest33-21ksoftirqd/220:55:542
3604992316,4cyclictest33-21ksoftirqd/223:11:552
3604992316,4cyclictest33-21ksoftirqd/222:57:302
3604992316,4cyclictest33-21ksoftirqd/202:21:292
3604992313,6cyclictest3583-21cyclictest01:32:412
3599992318,3cyclictest25-21ksoftirqd/122:22:521
3599992318,3cyclictest25-21ksoftirqd/101:38:001
3599992317,3cyclictest28973-21head22:48:011
3599992317,3cyclictest25-21ksoftirqd/123:05:431
3599992316,4cyclictest25-21ksoftirqd/122:33:081
3599992316,4cyclictest25-21ksoftirqd/121:00:311
3593992317,3cyclictest9-21ksoftirqd/022:17:140
3593992317,3cyclictest9-21ksoftirqd/022:11:310
3593992317,3cyclictest9-21ksoftirqd/000:48:330
3593992316,4cyclictest9-21ksoftirqd/022:37:130
3604992217,3cyclictest33-21ksoftirqd/223:25:062
3604992216,3cyclictest33-21ksoftirqd/222:19:442
3604992216,3cyclictest33-21ksoftirqd/220:59:232
3604992215,4cyclictest33-21ksoftirqd/223:53:232
3604992215,4cyclictest33-21ksoftirqd/221:23:002
3604992215,4cyclictest25825-21phc2sys01:27:552
3604992215,4cyclictest21476-21tr21:27:382
3599992217,3cyclictest25-21ksoftirqd/101:42:541
3599992215,4cyclictest25689-21cpuspeed_turbos23:27:441
3599992215,4cyclictest25-21ksoftirqd/101:28:291
3593992217,3cyclictest9-21ksoftirqd/001:53:000
3593992217,3cyclictest9-21ksoftirqd/001:17:520
3593992217,3cyclictest9-21ksoftirqd/001:12:230
3593992216,3cyclictest9-21ksoftirqd/022:43:580
3593992216,3cyclictest9-21ksoftirqd/022:43:580
3593992216,3cyclictest9-21ksoftirqd/021:46:420
359399221,3cyclictest121rcu_preempt02:18:390
3593992211,8cyclictest31137-21grep21:47:400
360499219,9cyclictest17124-21needreboot01:57:552
3604992115,3cyclictest33-21ksoftirqd/221:15:362
3604992114,4cyclictest4850-21sh00:22:292
3604992114,4cyclictest4850-21sh00:22:292
3604992114,4cyclictest27131-21timedrift23:28:052
3604992114,4cyclictest1779-21runrttasks00:12:422
3599992116,3cyclictest25-21ksoftirqd/122:57:531
3599992116,3cyclictest25-21ksoftirqd/100:52:511
3593992116,3cyclictest9-21ksoftirqd/001:48:010
3593992115,4cyclictest9-21ksoftirqd/022:26:530
3604992015,3cyclictest33-21ksoftirqd/200:52:592
3604992014,4cyclictest33-21ksoftirqd/200:02:422
3604992014,3cyclictest3231-21sh01:00:162
3604992014,3cyclictest27609-21sh00:49:552
3604992014,3cyclictest1463-21cpuspeed_turbos23:37:422
3604992013,4cyclictest217-21systemd-journal00:32:212
3604992013,4cyclictest16059-21sh01:17:122
3599992015,3cyclictest25-21ksoftirqd/101:18:091
3599992014,3cyclictest25-21ksoftirqd/102:10:281
3599992014,3cyclictest25-21ksoftirqd/102:10:281
3593992015,3cyclictest9-21ksoftirqd/021:34:300
3593992015,3cyclictest9-21ksoftirqd/000:22:480
3593992015,3cyclictest9-21ksoftirqd/000:22:480
3604991913,4cyclictest12617-21sed21:07:462
3604991913,3cyclictest5019-21basename01:42:522
3604991913,3cyclictest18670-21cut23:57:522
3604991913,3cyclictest18269-21phc2sys-jitter00:37:532
3604991913,3cyclictest1779-21runrttasks01:27:002
3604991912,4cyclictest8541-21expr01:47:502
3604991912,4cyclictest29693-21/usr/sbin/munin23:32:542
3599991914,3cyclictest25-21ksoftirqd/100:22:491
3599991914,3cyclictest25-21ksoftirqd/100:22:491
3599991913,3cyclictest11571-21/usr/sbin/munin21:07:501
359399193,10cyclictest9281-21apt-get21:02:350
359399193,10cyclictest16594-21apt-get21:17:400
3593991914,3cyclictest9-21ksoftirqd/000:56:080
3593991913,3cyclictest9-21ksoftirqd/020:52:480
3604991812,3cyclictest21339-21cat00:42:442
360499180,16cyclictest0-21swapper/221:47:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional