You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 01:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Sat Dec 09, 2023 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
568524780,4sleep10-21swapper/108:06:151
46021760,5sleep3639699cyclictest12:41:123
46021760,5sleep3639699cyclictest12:41:123
2163421520,3sleep2639099cyclictest09:46:072
1791911160,8ptp4l13399-21kworker/3:208:06:243
179191760,1ptp4l401ktimersoftd/310:17:323
6396996450,7cyclictest41-21ksoftirqd/312:31:093
44642630,1sleep00-21swapper/012:08:490
134412590,3sleep3401ktimersoftd/311:41:343
638299586,3cyclictest25-21ksoftirqd/111:51:051
59652584,10sleep20-21swapper/208:06:542
37492580,2sleep00-21swapper/009:11:000
33102580,4sleep3639699cyclictest12:06:273
6375995547,4cyclictest9-21ksoftirqd/009:36:000
268212550,5sleep226818-21snmp_o5powerctl13:11:222
6396995441,7cyclictest41-21ksoftirqd/312:36:043
638299546,5cyclictest25-21ksoftirqd/111:06:061
638299545,11cyclictest25-21ksoftirqd/110:50:421
6382995423,8cyclictest25-21ksoftirqd/111:21:041
179191540,2ptp4l862-21kworker/3:210:01:143
639099533,12cyclictest21441-21/usr/sbin/munin13:06:082
6382995226,4cyclictest25-21ksoftirqd/112:41:101
6382995226,4cyclictest25-21ksoftirqd/112:41:101
6382995220,8cyclictest25-21ksoftirqd/111:56:201
6382995220,7cyclictest25-21ksoftirqd/112:56:131
6382995216,4cyclictest25-21ksoftirqd/110:06:091
6396995111,22cyclictest41-21ksoftirqd/311:51:053
639099515,11cyclictest14201-21ssh12:56:282
639099512,13cyclictest11824-21awk11:41:082
6382995137,3cyclictest25-21ksoftirqd/111:05:421
6382995126,7cyclictest25-21ksoftirqd/113:01:051
6382995125,4cyclictest25-21ksoftirqd/108:30:381
6382995121,8cyclictest25-21ksoftirqd/112:06:061
6382995120,5cyclictest25-21ksoftirqd/113:26:101
639099502,12cyclictest14003-21idleruntime09:31:052
6382995044,3cyclictest25-21ksoftirqd/112:46:071
6382995044,3cyclictest25-21ksoftirqd/112:46:071
6382995044,3cyclictest25-21ksoftirqd/109:20:441
638299504,11cyclictest25-21ksoftirqd/110:26:071
6382995025,7cyclictest25-21ksoftirqd/111:27:151
6382995025,4cyclictest25-21ksoftirqd/113:20:451
6382995024,4cyclictest25-21ksoftirqd/113:11:171
6382995024,4cyclictest25-21ksoftirqd/112:11:131
6382995024,4cyclictest25-21ksoftirqd/110:51:091
6382995024,4cyclictest25-21ksoftirqd/110:51:091
6382995024,3cyclictest25-21ksoftirqd/113:33:181
6382995023,8cyclictest25-21ksoftirqd/112:19:071
6382995023,4cyclictest25-21ksoftirqd/110:11:451
6382995020,10cyclictest25-21ksoftirqd/111:36:161
6382995019,9cyclictest25-21ksoftirqd/110:41:091
6382995019,6cyclictest25-21ksoftirqd/111:46:021
179191500,1ptp4l401ktimersoftd/309:15:183
179191500,1ptp4l401ktimersoftd/308:24:003
639099492,13cyclictest18070-21latency10:31:112
639099492,13cyclictest15325-21missed_timers11:06:112
639099492,12cyclictest14678-21grep08:26:002
6382994938,3cyclictest25-21ksoftirqd/110:40:411
6382994935,3cyclictest25-21ksoftirqd/109:35:401
6382994924,8cyclictest25-21ksoftirqd/112:51:241
6382994924,4cyclictest25-21ksoftirqd/108:31:031
6382994923,8cyclictest25-21ksoftirqd/112:01:051
6382994922,9cyclictest25-21ksoftirqd/112:24:131
6382994922,4cyclictest25-21ksoftirqd/113:06:061
6382994919,4cyclictest25-21ksoftirqd/112:40:441
6382994918,10cyclictest25-21ksoftirqd/110:01:051
133872490,2sleep30-21swapper/312:18:443
6396994837,5cyclictest41-21ksoftirqd/309:01:003
639099482,13cyclictest23469-21timerwakeupswit08:41:232
638299483,9cyclictest25-21ksoftirqd/110:21:091
6382994831,3cyclictest25-21ksoftirqd/109:56:141
6382994824,3cyclictest25-21ksoftirqd/108:51:081
6382994823,4cyclictest25-21ksoftirqd/108:56:121
6382994822,4cyclictest25-21ksoftirqd/109:28:491
6382994821,8cyclictest25-21ksoftirqd/112:28:141
6382994819,10cyclictest25-21ksoftirqd/109:06:191
6382994819,10cyclictest25-21ksoftirqd/109:06:191
145132480,2sleep20-21swapper/212:20:442
639099472,18cyclictest32579-21diskmemload10:18:362
639099471,12cyclictest14959-21cpuspeed_turbos12:21:082
638299475,6cyclictest26156-21apt-get11:20:421
638299474,11cyclictest25-21ksoftirqd/111:31:081
638299473,4cyclictest121rcu_preempt13:25:451
6382994721,9cyclictest25-21ksoftirqd/110:20:351
6382994721,8cyclictest25-21ksoftirqd/111:11:591
6382994720,8cyclictest25-21ksoftirqd/112:32:351
6382994718,4cyclictest25-21ksoftirqd/111:41:491
274802470,1sleep20-21swapper/211:57:392
179191470,1ptp4l401ktimersoftd/312:05:103
639099462,10cyclictest26425-21irqrtprio09:56:082
639099460,17cyclictest12191-21ssh11:02:002
638299464,8cyclictest18140-21munin-run09:40:401
638299464,11cyclictest25-21ksoftirqd/109:11:021
6382994622,3cyclictest25-21ksoftirqd/108:21:011
6382994621,9cyclictest25-21ksoftirqd/109:41:191
6382994621,8cyclictest25-21ksoftirqd/109:51:021
6375994640,4cyclictest6386-21latency_hist08:10:380
639099456,6cyclictest0-21swapper/210:39:382
639099456,6cyclictest0-21swapper/208:31:112
639099451,12cyclictest24378-21ssh12:31:162
639099451,12cyclictest15053-21ssh13:36:162
639099450,12cyclictest15791-21ssh11:45:532
6382994535,3cyclictest25-21ksoftirqd/109:16:101
6382994521,7cyclictest25-21ksoftirqd/109:46:031
6382994520,8cyclictest25-21ksoftirqd/110:34:151
6375994536,5cyclictest9-21ksoftirqd/011:06:020
639099441,12cyclictest6528-21ssh12:11:122
638299444,7cyclictest25-21ksoftirqd/108:36:071
638299443,8cyclictest25-21ksoftirqd/113:36:251
6382994433,3cyclictest25-21ksoftirqd/108:16:141
638299440,10cyclictest25-21ksoftirqd/110:56:121
639099432,11cyclictest32579-21diskmemload12:01:232
638299434,8cyclictest25-21ksoftirqd/109:01:051
639099424,8cyclictest11936-21munin-run08:20:382
6382994235,3cyclictest25-21ksoftirqd/108:10:431
6382994222,4cyclictest25-21ksoftirqd/108:46:081
638299421,6cyclictest0-21swapper/108:41:141
639099412,16cyclictest32579-21diskmemload13:21:032
6396994029,5cyclictest41-21ksoftirqd/309:46:013
639099400,17cyclictest32579-21diskmemload12:54:022
639099400,10cyclictest0-21swapper/210:06:122
179191390,1ptp4l401ktimersoftd/313:08:063
179191390,1ptp4l401ktimersoftd/311:27:593
639099384,6cyclictest994-21ps12:41:162
639099384,6cyclictest994-21ps12:41:162
6375993832,3cyclictest9-21ksoftirqd/012:15:440
179191380,1ptp4l401ktimersoftd/312:27:253
179191380,1ptp4l401ktimersoftd/311:09:343
179191380,1ptp4l401ktimersoftd/310:53:453
179191380,1ptp4l401ktimersoftd/310:53:453
179191380,1ptp4l401ktimersoftd/310:41:433
179191380,1ptp4l401ktimersoftd/310:34:453
179191380,0ptp4l401ktimersoftd/311:13:563
179191370,1ptp4l401ktimersoftd/313:26:193
179191370,1ptp4l401ktimersoftd/313:21:493
179191370,1ptp4l401ktimersoftd/313:13:313
179191370,1ptp4l401ktimersoftd/313:05:063
179191370,1ptp4l401ktimersoftd/312:46:073
179191370,1ptp4l401ktimersoftd/312:46:073
179191370,1ptp4l401ktimersoftd/312:24:443
179191370,1ptp4l401ktimersoftd/311:16:423
179191370,1ptp4l401ktimersoftd/308:51:253
179191360,1ptp4l401ktimersoftd/313:16:083
179191360,1ptp4l401ktimersoftd/311:31:183
179191360,1ptp4l401ktimersoftd/310:14:483
6375993524,6cyclictest9-21ksoftirqd/012:51:060
179191350,1ptp4l401ktimersoftd/312:11:593
179191350,1ptp4l401ktimersoftd/311:46:123
179191350,1ptp4l401ktimersoftd/310:25:353
179191350,1ptp4l401ktimersoftd/308:26:113
6396993429,3cyclictest41-21ksoftirqd/310:35:413
6396993429,3cyclictest41-21ksoftirqd/309:35:403
639099345,6cyclictest19982-21ssh13:04:122
639099345,12cyclictest18091-21seq11:10:442
637599345,7cyclictest9-21ksoftirqd/010:50:420
6375993428,3cyclictest9-21ksoftirqd/012:21:080
179191340,1ptp4l401ktimersoftd/313:37:583
6396993328,3cyclictest41-21ksoftirqd/309:45:403
6396993328,3cyclictest41-21ksoftirqd/309:25:403
6396993327,3cyclictest41-21ksoftirqd/312:55:453
639099336,12cyclictest642-21in:imuxsock09:08:282
639099336,12cyclictest642-21in:imuxsock09:08:282
639099336,10cyclictest27940-21apt-get12:36:052
6375993327,3cyclictest9-21ksoftirqd/011:55:440
6375993327,3cyclictest9-21ksoftirqd/008:26:040
194622330,2sleep00-21swapper/008:35:390
179191330,1ptp4l401ktimersoftd/311:57:373
179191330,1ptp4l401ktimersoftd/310:57:493
6375993227,3cyclictest9-21ksoftirqd/013:10:450
6375993226,3cyclictest9-21ksoftirqd/012:36:130
6375993226,3cyclictest9-21ksoftirqd/011:41:120
6375993226,3cyclictest1012-21apt12:05:440
179191320,1ptp4l401ktimersoftd/312:55:563
179191320,1ptp4l401ktimersoftd/311:02:003
179191320,1ptp4l401ktimersoftd/310:47:043
179191320,1ptp4l401ktimersoftd/310:29:353
179191320,1ptp4l401ktimersoftd/310:06:203
6396993126,3cyclictest41-21ksoftirqd/309:16:083
6396993125,3cyclictest41-21ksoftirqd/308:56:043
639099316,6cyclictest10945-21ssh11:40:332
639099314,7cyclictest12876-21ssh13:34:232
639099313,5cyclictest0-21swapper/210:46:142
639099313,13cyclictest21606-21phc2sys-jitter11:51:162
639099312,14cyclictest23414-21bc09:51:022
637599315,3cyclictest9-21ksoftirqd/011:31:080
6375993126,3cyclictest9-21ksoftirqd/013:20:450
6375993125,3cyclictest9-21ksoftirqd/012:26:080
6375993125,3cyclictest9-21ksoftirqd/010:41:090
6375993125,3cyclictest9-21ksoftirqd/010:35:410
6375993123,4cyclictest9-21ksoftirqd/011:26:060
637599310,5cyclictest121rcu_preempt11:00:420
179191310,1ptp4l401ktimersoftd/313:31:343
179191310,1ptp4l401ktimersoftd/309:54:393
179191310,1ptp4l401ktimersoftd/309:07:293
179191310,1ptp4l401ktimersoftd/309:07:293
179191310,0ptp4l401ktimersoftd/309:57:333
6396993024,3cyclictest41-21ksoftirqd/308:20:393
639099306,7cyclictest4426-21ssh10:53:192
639099306,7cyclictest4426-21ssh10:53:192
639099305,12cyclictest32313-21sed09:01:082
639099303,6cyclictest0-21swapper/212:30:292
639099303,23cyclictest140052chrt08:21:482
637599305,3cyclictest9-21ksoftirqd/010:21:090
6375993025,3cyclictest9-21ksoftirqd/012:16:120
6375993025,3cyclictest9-21ksoftirqd/011:16:140
6375993025,3cyclictest9-21ksoftirqd/010:36:030
6375993024,3cyclictest9-21ksoftirqd/013:26:170
6375993024,3cyclictest9-21ksoftirqd/011:11:110
6375993016,4cyclictest9-21ksoftirqd/008:56:070
179191300,0ptp4l401ktimersoftd/308:32:453
639099296,6cyclictest0-21swapper/211:16:172
639099294,7cyclictest5581-21ssh11:33:322
639099294,6cyclictest0-21swapper/212:48:032
639099294,6cyclictest0-21swapper/212:48:032
639099293,12cyclictest12840-21/usr/sbin/munin10:26:042
639099290,11cyclictest2226-21ssh11:30:292
6375992924,3cyclictest9-21ksoftirqd/012:46:190
6375992924,3cyclictest9-21ksoftirqd/012:46:190
6375992924,3cyclictest9-21ksoftirqd/010:16:090
6375992924,3cyclictest9-21ksoftirqd/008:16:040
6375992923,3cyclictest9-21ksoftirqd/010:06:010
6375992923,3cyclictest9-21ksoftirqd/009:51:090
6375992923,3cyclictest9-21ksoftirqd/009:31:050
179191290,1ptp4l401ktimersoftd/309:37:213
109882290,2sleep30-21swapper/311:40:383
6396992823,3cyclictest41-21ksoftirqd/311:25:433
6396992822,3cyclictest41-21ksoftirqd/309:30:403
639099285,6cyclictest8230-21ssh10:57:292
639099285,6cyclictest5322-21ssh12:10:382
639099281,12cyclictest0-21swapper/210:11:192
6375992824,3cyclictest9-21ksoftirqd/013:21:120
6375992823,3cyclictest9-21ksoftirqd/012:45:440
6375992823,3cyclictest9-21ksoftirqd/012:45:440
6375992823,3cyclictest9-21ksoftirqd/011:20:430
6375992822,3cyclictest9-21ksoftirqd/010:11:290
6375992822,3cyclictest9-21ksoftirqd/009:16:040
6375992821,4cyclictest9-21ksoftirqd/008:48:440
637599281,4cyclictest9-21ksoftirqd/011:01:070
179191280,1ptp4l401ktimersoftd/308:49:473
6396992722,3cyclictest41-21ksoftirqd/308:10:393
639099276,7cyclictest0-21swapper/210:05:412
639099275,6cyclictest425-21ssh13:19:412
6390992721,3cyclictest33-21ksoftirqd/209:17:262
6390992720,4cyclictest33-21ksoftirqd/209:40:402
6390992720,3cyclictest33-21ksoftirqd/208:15:132
6375992722,3cyclictest9-21ksoftirqd/013:11:270
6375992722,3cyclictest9-21ksoftirqd/013:05:450
6375992722,3cyclictest9-21ksoftirqd/013:00:450
6375992722,3cyclictest9-21ksoftirqd/011:56:060
6375992722,3cyclictest9-21ksoftirqd/010:26:110
6375992722,3cyclictest9-21ksoftirqd/008:21:070
6375992721,3cyclictest9-21ksoftirqd/009:06:080
6375992721,3cyclictest9-21ksoftirqd/009:06:080
6375992721,3cyclictest9-21ksoftirqd/009:01:020
6375992721,3cyclictest9-21ksoftirqd/008:35:380
6396992621,3cyclictest41-21ksoftirqd/308:36:073
639099267,5cyclictest0-21swapper/209:21:022
639099265,7cyclictest12213-21ssh10:25:072
6390992619,4cyclictest27158-21sed08:51:052
6390992619,4cyclictest26089-21tail10:41:062
6375992621,3cyclictest9-21ksoftirqd/010:51:030
6375992621,3cyclictest9-21ksoftirqd/010:51:030
6375992621,3cyclictest9-21ksoftirqd/010:01:070
6375992621,3cyclictest9-21ksoftirqd/009:46:080
6375992620,4cyclictest9-21ksoftirqd/011:46:050
6375992620,3cyclictest9-21ksoftirqd/009:56:030
6375992620,3cyclictest9-21ksoftirqd/008:15:380
637599260,3cyclictest121rcu_preempt13:36:260
6396992519,3cyclictest41-21ksoftirqd/308:42:333
639099258,12cyclictest0-21swapper/208:36:002
639099256,5cyclictest7807-21ssh13:27:152
6390992520,3cyclictest33-21ksoftirqd/208:46:152
6375992519,3cyclictest9-21ksoftirqd/011:40:430
6375992519,3cyclictest9-21ksoftirqd/009:41:010
6375992519,3cyclictest9-21ksoftirqd/009:23:020
6390992419,3cyclictest33-21ksoftirqd/208:56:072
6390992417,4cyclictest33-21ksoftirqd/209:28:042
6375992419,3cyclictest9-21ksoftirqd/012:35:440
6375992417,4cyclictest9-21ksoftirqd/009:25:410
6375992318,3cyclictest9-21ksoftirqd/013:31:260
6375992318,3cyclictest9-21ksoftirqd/008:41:030
6375992317,3cyclictest9-21ksoftirqd/008:51:240
639099228,11cyclictest28598-21unixbench_singl11:21:222
639099228,10cyclictest0-21swapper/209:41:012
639099218,9cyclictest3972-21ls09:11:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional