You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-08 - 01:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Thu Dec 07, 2023 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2924523430,5sleep30-21swapper/308:05:003
3084321840,3sleep33053499cyclictest08:09:523
1963821580,4sleep13052199cyclictest10:45:471
179191750,1ptp4l401ktimersoftd/313:27:363
282992654,10sleep00-21swapper/008:04:500
250312620,4sleep13052199cyclictest12:20:021
179191590,1ptp4l401ktimersoftd/312:35:183
179191580,1ptp4l401ktimersoftd/313:07:203
179191570,1ptp4l401ktimersoftd/310:46:363
143122570,4sleep2321ktimersoftd/210:39:582
179191560,1ptp4l401ktimersoftd/312:12:533
12442560,2sleep33053499cyclictest13:12:033
23912540,4sleep2321ktimersoftd/210:24:202
179191540,1ptp4l401ktimersoftd/310:56:393
179191520,1ptp4l401ktimersoftd/309:36:473
3051699490,7cyclictest0-21swapper/011:24:360
3051699490,6cyclictest0-21swapper/012:00:030
3051699483,6cyclictest101ktimersoftd/012:59:380
302162474,31sleep10-21swapper/108:06:571
179191470,1ptp4l401ktimersoftd/311:20:563
179191470,0ptp4l401ktimersoftd/313:21:323
3051699462,7cyclictest11146-21latency_hist11:19:360
302592464,29sleep20-21swapper/208:07:302
3051699452,7cyclictest101ktimersoftd/011:35:160
3051699452,7cyclictest101ktimersoftd/011:35:160
3051699447,10cyclictest9-21ksoftirqd/013:35:010
3051699441,7cyclictest6539-21latency_hist13:19:390
3051699440,8cyclictest101ktimersoftd/008:20:000
179191440,1ptp4l401ktimersoftd/311:49:443
3051699435,8cyclictest9-21ksoftirqd/010:09:550
3051699432,7cyclictest9-21ksoftirqd/011:10:560
3051699426,7cyclictest9-21ksoftirqd/013:09:520
3051699423,6cyclictest9-21ksoftirqd/013:31:030
3051699423,6cyclictest9-21ksoftirqd/013:31:030
3051699423,6cyclictest9-21ksoftirqd/011:46:240
3051699423,5cyclictest101ktimersoftd/012:34:380
3051699421,5cyclictest15363-21awk10:40:120
3051699420,39cyclictest101ktimersoftd/013:20:030
179191420,1ptp4l401ktimersoftd/312:42:163
3051699415,6cyclictest9-21ksoftirqd/012:38:210
3051699413,7cyclictest24047-21cut13:00:070
3051699413,6cyclictest9-21ksoftirqd/011:07:350
3051699412,7cyclictest9-21ksoftirqd/010:55:200
3051699412,6cyclictest10196-21sed08:30:100
3051699405,7cyclictest9-21ksoftirqd/012:52:130
3051699405,7cyclictest9-21ksoftirqd/011:30:090
3051699403,6cyclictest9-21ksoftirqd/010:51:040
3051699403,6cyclictest9-21ksoftirqd/008:35:010
3051699400,7cyclictest101ktimersoftd/009:19:330
179191400,1ptp4l401ktimersoftd/313:34:393
179191400,1ptp4l401ktimersoftd/313:34:393
179191400,1ptp4l401ktimersoftd/312:21:473
179191400,1ptp4l401ktimersoftd/311:09:593
3051699398,3cyclictest9-21ksoftirqd/008:44:160
3051699396,7cyclictest9-21ksoftirqd/010:35:130
3051699395,4cyclictest9-21ksoftirqd/010:20:290
3051699394,7cyclictest9-21ksoftirqd/013:25:080
3051699394,6cyclictest0-21swapper/010:15:130
3051699394,5cyclictest20988-21ssh12:15:030
3051699393,6cyclictest9-21ksoftirqd/011:00:180
3051699393,5cyclictest0-21swapper/011:42:460
3051699393,5cyclictest0-21swapper/011:42:460
3051699392,5cyclictest23326-21tune2fs08:59:570
3051699390,5cyclictest9-21ksoftirqd/012:08:220
179191390,1ptp4l401ktimersoftd/309:24:563
179191390,0ptp4l401ktimersoftd/311:15:053
30521993831,4cyclictest25017-21turbostat09:04:331
30521993830,5cyclictest25-21ksoftirqd/109:44:561
30521993829,5cyclictest25-21ksoftirqd/111:55:021
3051699385,8cyclictest9-21ksoftirqd/008:09:530
3051699385,5cyclictest0-21swapper/009:21:180
3051699382,6cyclictest101ktimersoftd/011:55:030
3051699380,5cyclictest101ktimersoftd/010:30:040
179191380,1ptp4l401ktimersoftd/312:56:023
179191380,1ptp4l401ktimersoftd/312:33:383
179191380,1ptp4l401ktimersoftd/311:40:323
179191380,1ptp4l401ktimersoftd/311:40:323
179191380,1ptp4l401ktimersoftd/311:33:273
3052999372,3cyclictest121rcu_preempt12:09:592
30521993732,3cyclictest25-21ksoftirqd/113:39:391
3051699376,7cyclictest9-21ksoftirqd/010:25:190
3051699376,6cyclictest9-21ksoftirqd/008:50:100
3051699375,9cyclictest9-21ksoftirqd/010:46:570
3051699375,7cyclictest9-21ksoftirqd/013:05:100
3051699375,7cyclictest9-21ksoftirqd/012:25:080
3051699375,7cyclictest9-21ksoftirqd/012:10:110
3051699374,7cyclictest9-21ksoftirqd/012:20:010
3051699373,7cyclictest0-21swapper/009:44:580
3051699372,5cyclictest9-21ksoftirqd/011:25:070
3051699370,6cyclictest101ktimersoftd/009:54:590
3051699370,6cyclictest101ktimersoftd/009:54:590
179191370,1ptp4l401ktimersoftd/313:36:433
179191370,1ptp4l401ktimersoftd/311:48:103
179191370,1ptp4l401ktimersoftd/310:26:343
179191370,1ptp4l401ktimersoftd/309:47:133
179191370,0ptp4l401ktimersoftd/313:18:403
179191370,0ptp4l401ktimersoftd/312:09:253
179191370,0ptp4l401ktimersoftd/312:00:303
179191370,0ptp4l401ktimersoftd/311:38:043
179191370,0ptp4l401ktimersoftd/311:38:043
179191370,0ptp4l401ktimersoftd/310:30:223
30529993631,3cyclictest33-21ksoftirqd/211:59:372
30521993630,3cyclictest25-21ksoftirqd/108:19:321
30521993625,9cyclictest25-21ksoftirqd/110:20:021
3051699363,7cyclictest0-21swapper/009:44:340
3051699361,6cyclictest9-21ksoftirqd/008:15:010
3051699360,6cyclictest9-21ksoftirqd/009:04:540
179191360,1ptp4l401ktimersoftd/311:58:233
179191360,1ptp4l401ktimersoftd/310:35:193
179191360,1ptp4l401ktimersoftd/310:23:553
179191360,0ptp4l401ktimersoftd/313:02:133
30521993530,3cyclictest25-21ksoftirqd/109:54:341
30521993529,3cyclictest25-21ksoftirqd/113:24:391
30521993529,3cyclictest25-21ksoftirqd/110:39:351
3051699355,6cyclictest13779-21ssh12:47:050
3051699354,7cyclictest9-21ksoftirqd/010:05:020
3051699352,6cyclictest9-21ksoftirqd/012:43:070
3051699351,5cyclictest9-21ksoftirqd/009:35:120
179191350,0ptp4l401ktimersoftd/312:27:533
179191350,0ptp4l401ktimersoftd/310:15:293
179191350,0ptp4l401ktimersoftd/309:14:593
30529993420,4cyclictest33-21ksoftirqd/211:28:242
30521993429,3cyclictest25-21ksoftirqd/111:24:361
30521993428,3cyclictest25-21ksoftirqd/113:05:031
30521993428,3cyclictest25-21ksoftirqd/112:39:381
30521993428,3cyclictest25-21ksoftirqd/109:39:331
3051699345,5cyclictest0-21swapper/009:12:030
30521993328,3cyclictest25-21ksoftirqd/110:50:021
30521993328,3cyclictest25-21ksoftirqd/109:19:331
30521993327,3cyclictest25-21ksoftirqd/112:45:031
30521993327,3cyclictest25-21ksoftirqd/108:29:591
30521993327,3cyclictest25-21ksoftirqd/108:14:321
30521993323,7cyclictest25-21ksoftirqd/109:54:561
30521993323,7cyclictest25-21ksoftirqd/109:54:561
3051699336,4cyclictest3494-21smartctl11:50:100
3051699335,4cyclictest9-21ksoftirqd/009:24:550
3051699334,5cyclictest9-21ksoftirqd/010:00:040
220392330,2sleep2311rcuc/213:38:402
179191330,1ptp4l401ktimersoftd/312:19:043
179191330,1ptp4l401ktimersoftd/309:58:553
179191330,1ptp4l401ktimersoftd/309:58:553
179191330,0ptp4l401ktimersoftd/311:04:163
179191330,0ptp4l401ktimersoftd/309:13:203
30529993226,3cyclictest33-21ksoftirqd/209:04:342
30529993220,10cyclictest33-21ksoftirqd/211:37:032
30529993220,10cyclictest33-21ksoftirqd/211:37:032
30521993227,3cyclictest25-21ksoftirqd/113:34:391
30521993227,3cyclictest25-21ksoftirqd/113:34:391
30521993227,3cyclictest25-21ksoftirqd/111:24:571
30521993226,3cyclictest25-21ksoftirqd/112:25:001
3051699323,7cyclictest9-21ksoftirqd/009:54:340
30516993210,7cyclictest9-21ksoftirqd/009:29:550
179191320,1ptp4l401ktimersoftd/312:49:503
179191320,1ptp4l401ktimersoftd/311:24:433
179191320,1ptp4l401ktimersoftd/311:07:393
179191320,1ptp4l401ktimersoftd/310:52:533
179191320,1ptp4l401ktimersoftd/308:45:143
179191320,0ptp4l401ktimersoftd/310:13:243
30529993116,6cyclictest33-21ksoftirqd/211:04:152
30521993126,3cyclictest25-21ksoftirqd/112:30:041
30521993126,3cyclictest25-21ksoftirqd/111:00:031
30521993125,4cyclictest25-21ksoftirqd/111:40:021
30521993125,4cyclictest25-21ksoftirqd/111:40:021
30521993125,3cyclictest25-21ksoftirqd/110:34:351
30521993125,3cyclictest25-21ksoftirqd/110:19:351
30521993125,3cyclictest25-21ksoftirqd/109:09:341
30521993124,4cyclictest25-21ksoftirqd/111:44:581
179191310,1ptp4l401ktimersoftd/308:52:023
179191310,1ptp4l401ktimersoftd/308:24:143
179191310,0ptp4l401ktimersoftd/308:43:523
3052999301,4cyclictest28775-21grep11:40:162
3052999301,4cyclictest28775-21grep11:40:162
30521993025,3cyclictest25-21ksoftirqd/111:34:361
30521993025,3cyclictest25-21ksoftirqd/110:10:021
30521993025,3cyclictest25-21ksoftirqd/109:30:031
30521993025,3cyclictest25-21ksoftirqd/108:39:591
30521993024,3cyclictest25-21ksoftirqd/112:55:091
30521993024,3cyclictest25-21ksoftirqd/112:54:381
30521993024,3cyclictest25-21ksoftirqd/111:19:361
30521993024,3cyclictest25-21ksoftirqd/109:09:521
30521993024,3cyclictest25-21ksoftirqd/108:24:531
30521993024,3cyclictest25-21ksoftirqd/108:19:581
213532300,5sleep23052999cyclictest08:55:002
179191300,1ptp4l401ktimersoftd/308:27:123
179191300,1ptp4l401ktimersoftd/308:18:383
179191300,0ptp4l401ktimersoftd/310:43:363
30529992924,3cyclictest33-21ksoftirqd/208:34:322
30529992923,3cyclictest33-21ksoftirqd/212:35:042
30521992925,3cyclictest25-21ksoftirqd/110:40:011
30521992924,3cyclictest25-21ksoftirqd/113:00:171
30521992924,3cyclictest25-21ksoftirqd/112:40:051
30521992924,3cyclictest25-21ksoftirqd/112:14:371
30521992924,3cyclictest25-21ksoftirqd/111:05:011
30521992923,3cyclictest25-21ksoftirqd/112:05:051
30521992923,3cyclictest25-21ksoftirqd/110:55:061
30521992923,3cyclictest25-21ksoftirqd/109:40:021
30521992923,3cyclictest25-21ksoftirqd/109:24:561
30521992923,3cyclictest25-21ksoftirqd/108:49:521
30521992922,4cyclictest25-21ksoftirqd/112:04:381
30521992922,4cyclictest25-21ksoftirqd/110:29:351
3051699294,6cyclictest9-21ksoftirqd/008:25:120
179191290,1ptp4l401ktimersoftd/309:23:323
179191290,0ptp4l401ktimersoftd/308:35:503
30529992823,3cyclictest33-21ksoftirqd/212:59:382
30529992823,3cyclictest33-21ksoftirqd/208:34:592
30529992822,3cyclictest33-21ksoftirqd/209:46:132
3052999281,3cyclictest121rcu_preempt12:40:172
30521992823,3cyclictest25-21ksoftirqd/111:39:361
30521992823,3cyclictest25-21ksoftirqd/111:39:361
30521992822,3cyclictest25-21ksoftirqd/113:15:061
30521992822,3cyclictest25-21ksoftirqd/110:09:351
30521992822,3cyclictest25-21ksoftirqd/108:35:101
30521992821,4cyclictest25-21ksoftirqd/113:14:141
179191280,1ptp4l401ktimersoftd/312:45:363
30534992720,4cyclictest41-21ksoftirqd/308:33:453
30529992721,4cyclictest33-21ksoftirqd/211:20:002
30529992721,3cyclictest33-21ksoftirqd/212:45:322
30529992721,3cyclictest33-21ksoftirqd/208:14:392
30529992720,4cyclictest33-21ksoftirqd/209:57:182
30529992720,4cyclictest33-21ksoftirqd/209:57:182
30529992720,4cyclictest33-21ksoftirqd/208:43:152
30529992720,4cyclictest33-21ksoftirqd/208:24:252
30529992716,9cyclictest33-21ksoftirqd/211:49:582
30521992722,3cyclictest25-21ksoftirqd/108:54:541
30521992722,3cyclictest25-21ksoftirqd/108:45:021
30521992721,3cyclictest25-21ksoftirqd/113:25:191
30521992720,4cyclictest4928-21tail11:10:071
30521992720,4cyclictest25-21ksoftirqd/112:14:581
3051699277,4cyclictest9-21ksoftirqd/008:55:280
3051699272,6cyclictest9-21ksoftirqd/008:45:040
237382270,4sleep2321ktimersoftd/210:51:582
30534992621,3cyclictest41-21ksoftirqd/310:09:353
30529992620,3cyclictest33-21ksoftirqd/209:30:192
30529992619,4cyclictest33-21ksoftirqd/209:42:492
30521992620,4cyclictest25-21ksoftirqd/110:00:091
30521992620,3cyclictest25-21ksoftirqd/111:49:561
30521992620,3cyclictest25-21ksoftirqd/109:20:021
3079222517,3sleep233-21ksoftirqd/208:09:522
30534992518,4cyclictest41-21ksoftirqd/309:51:573
3052999256,17cyclictest33-21ksoftirqd/210:09:572
30529992521,3cyclictest33-21ksoftirqd/212:25:162
30529992520,3cyclictest33-21ksoftirqd/210:35:052
30529992520,3cyclictest33-21ksoftirqd/209:09:522
30529992519,3cyclictest33-21ksoftirqd/210:03:112
179191250,1ptp4l401ktimersoftd/309:59:573
179191250,1ptp4l401ktimersoftd/309:30:223
179191250,1ptp4l401ktimersoftd/309:00:063
143322518,3sleep233-21ksoftirqd/213:12:312
30529992420,3cyclictest33-21ksoftirqd/210:05:212
30529992419,3cyclictest33-21ksoftirqd/212:30:162
30529992419,3cyclictest33-21ksoftirqd/212:15:072
30529992419,3cyclictest33-21ksoftirqd/210:14:572
30529992419,3cyclictest33-21ksoftirqd/209:50:032
30529992417,4cyclictest33-21ksoftirqd/209:35:262
30529992417,4cyclictest33-21ksoftirqd/209:17:242
30529992417,4cyclictest33-21ksoftirqd/209:07:442
30529992417,4cyclictest33-21ksoftirqd/208:45:562
3052999240,7cyclictest121rcu_preempt11:05:012
179191240,1ptp4l401ktimersoftd/309:39:583
179191240,1ptp4l401ktimersoftd/309:04:373
30529992319,3cyclictest33-21ksoftirqd/213:30:172
30529992319,3cyclictest33-21ksoftirqd/213:30:172
30529992318,3cyclictest33-21ksoftirqd/213:20:132
30529992318,3cyclictest33-21ksoftirqd/211:15:022
3052999231,7cyclictest14416-21cron13:29:392
30529992317,3cyclictest33-21ksoftirqd/209:26:062
30529992316,4cyclictest33-21ksoftirqd/210:30:032
3052999230,7cyclictest4500-21unixbench_singl13:15:182
179191230,1ptp4l401ktimersoftd/308:54:483
3052999222,4cyclictest7065-21cron11:14:352
30529992218,3cyclictest33-21ksoftirqd/212:20:082
30529992217,3cyclictest33-21ksoftirqd/213:05:032
30529992216,3cyclictest33-21ksoftirqd/212:53:112
30529992216,3cyclictest33-21ksoftirqd/211:47:392
30529992215,4cyclictest33-21ksoftirqd/209:19:542
30529992116,3cyclictest33-21ksoftirqd/213:00:352
30529992116,3cyclictest33-21ksoftirqd/208:24:562
3052999210,7cyclictest25767-21tr10:55:062
30529992015,3cyclictest33-21ksoftirqd/212:05:052
30529992015,3cyclictest33-21ksoftirqd/212:00:072
30529992015,3cyclictest33-21ksoftirqd/210:44:582
30529991913,3cyclictest4383-21switchtime10:25:172
30529991913,3cyclictest33-21ksoftirqd/211:30:012
30529991812,3cyclictest18607-21fw_packets08:49:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional