You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-29 - 08:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Thu Feb 29, 2024 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
179191960,4ptp4l401ktimersoftd/320:54:173
179191730,1ptp4l401ktimersoftd/301:41:413
179191730,1ptp4l401ktimersoftd/301:41:413
179191730,1ptp4l401ktimersoftd/301:25:383
179191710,1ptp4l401ktimersoftd/301:06:383
179191700,1ptp4l401ktimersoftd/301:51:273
131542660,4sleep013158-21fschecks_time22:51:050
247922620,4sleep02152699cyclictest23:06:110
179191620,2ptp4l3052-21kworker/3:000:31:123
255852590,4sleep1231rcuc/123:46:511
175782580,5sleep341-21ksoftirqd/302:18:123
179191570,1ptp4l401ktimersoftd/300:11:343
179191560,2ptp4l401ktimersoftd/321:46:153
138892550,4sleep22153899cyclictest00:51:192
21532995042,4cyclictest25-21ksoftirqd/121:15:551
21532994937,6cyclictest25-21ksoftirqd/123:16:031
179191490,0ptp4l401ktimersoftd/300:23:153
21532994837,6cyclictest25-21ksoftirqd/100:36:051
21532994737,5cyclictest25-21ksoftirqd/122:41:021
21532994737,5cyclictest25-21ksoftirqd/121:40:571
21532994735,6cyclictest25-21ksoftirqd/121:31:001
179191470,1ptp4l401ktimersoftd/322:49:063
21532994636,5cyclictest25-21ksoftirqd/123:41:011
21532994636,5cyclictest25-21ksoftirqd/123:41:011
179191450,1ptp4l401ktimersoftd/323:59:363
21532994433,4cyclictest25-21ksoftirqd/100:11:011
21532994330,7cyclictest25-21ksoftirqd/123:25:581
179191430,1ptp4l401ktimersoftd/323:24:073
21532994228,5cyclictest25-21ksoftirqd/123:21:011
179191390,1ptp4l401ktimersoftd/301:14:313
21546993823,8cyclictest41-21ksoftirqd/323:10:583
179191380,1ptp4l401ktimersoftd/323:29:553
179191380,1ptp4l401ktimersoftd/323:15:573
179191380,1ptp4l401ktimersoftd/323:08:253
179191380,1ptp4l401ktimersoftd/321:58:063
179191380,1ptp4l401ktimersoftd/321:58:063
179191380,1ptp4l401ktimersoftd/300:57:413
179191380,1ptp4l401ktimersoftd/300:52:513
179191380,1ptp4l401ktimersoftd/300:47:223
179191380,0ptp4l401ktimersoftd/302:10:213
179191380,0ptp4l401ktimersoftd/300:17:563
197182370,7sleep119714-21fschecks_time20:51:001
179191370,1ptp4l401ktimersoftd/323:49:243
179191370,1ptp4l401ktimersoftd/322:58:093
179191370,1ptp4l401ktimersoftd/322:18:463
179191370,1ptp4l401ktimersoftd/300:36:363
2153299364,12cyclictest941-21ssh01:56:081
179191360,1ptp4l401ktimersoftd/301:03:553
179191360,1ptp4l401ktimersoftd/300:08:553
179191360,0ptp4l401ktimersoftd/301:47:283
179191360,0ptp4l401ktimersoftd/300:03:103
85232350,4sleep12153299cyclictest01:25:231
196482352,13sleep019715-21fschecks_time20:51:000
179191350,0ptp4l401ktimersoftd/323:33:323
2153299346,8cyclictest25-21ksoftirqd/122:20:371
21532993429,3cyclictest25-21ksoftirqd/101:26:191
21532993428,3cyclictest25-21ksoftirqd/121:25:361
21532993428,3cyclictest25-21ksoftirqd/102:25:431
21532993428,3cyclictest25-21ksoftirqd/101:20:411
21532993423,5cyclictest25-21ksoftirqd/121:10:571
179191340,2ptp4l21770-21kworker/3:201:26:363
179191340,11ptp4l401ktimersoftd/323:45:333
179191340,11ptp4l401ktimersoftd/323:45:333
2153299337,23cyclictest1091-21ssh23:56:271
21532993328,3cyclictest25-21ksoftirqd/101:50:411
21532993328,3cyclictest25-21ksoftirqd/101:10:401
21532993328,3cyclictest25-21ksoftirqd/101:05:411
21532993328,3cyclictest25-21ksoftirqd/100:56:131
21532993328,3cyclictest25-21ksoftirqd/100:30:401
21532993327,3cyclictest25-21ksoftirqd/122:50:381
21532993326,4cyclictest25-21ksoftirqd/100:51:081
21532993317,13cyclictest25-21ksoftirqd/122:58:131
179191330,2ptp4l3052-21kworker/3:021:41:183
179191330,1ptp4l401ktimersoftd/322:26:183
179191330,1ptp4l401ktimersoftd/302:12:223
424623224,3sleep233-21ksoftirqd/222:31:172
21532993227,3cyclictest25-21ksoftirqd/122:06:051
21532993227,3cyclictest25-21ksoftirqd/122:05:371
21532993227,3cyclictest25-21ksoftirqd/122:05:371
21532993227,3cyclictest25-21ksoftirqd/102:10:421
21532993227,3cyclictest25-21ksoftirqd/101:55:321
21532993227,3cyclictest25-21ksoftirqd/101:31:071
21532993226,3cyclictest25-21ksoftirqd/123:01:091
21532993226,3cyclictest25-21ksoftirqd/122:00:361
21532993226,3cyclictest25-21ksoftirqd/122:00:361
21532993226,3cyclictest25-21ksoftirqd/102:01:131
21532993219,4cyclictest25-21ksoftirqd/100:02:121
179191320,1ptp4l401ktimersoftd/321:26:433
179191320,1ptp4l401ktimersoftd/301:37:233
179191320,1ptp4l401ktimersoftd/301:31:333
179191320,1ptp4l401ktimersoftd/301:17:393
179191320,1ptp4l401ktimersoftd/300:44:073
21532993125,4cyclictest25-21ksoftirqd/120:56:011
21532993125,3cyclictest25-21ksoftirqd/122:51:201
21532993125,3cyclictest25-21ksoftirqd/100:41:001
21546993025,3cyclictest41-21ksoftirqd/321:05:353
21546993014,6cyclictest401ktimersoftd/321:50:593
21532993025,3cyclictest25-21ksoftirqd/123:51:001
21532993025,3cyclictest25-21ksoftirqd/123:51:001
21532993025,3cyclictest25-21ksoftirqd/123:11:061
21532993025,3cyclictest25-21ksoftirqd/122:26:011
21532993025,3cyclictest25-21ksoftirqd/102:11:101
21532993025,3cyclictest25-21ksoftirqd/101:41:051
21532993025,3cyclictest25-21ksoftirqd/101:41:051
21532993025,3cyclictest25-21ksoftirqd/100:46:121
21532993025,3cyclictest25-21ksoftirqd/100:16:131
21532993024,3cyclictest25-21ksoftirqd/121:36:141
21526993024,3cyclictest9-21ksoftirqd/021:51:010
205492305,10sleep20-21swapper/220:51:102
179191300,1ptp4l401ktimersoftd/322:01:493
179191300,1ptp4l401ktimersoftd/322:01:493
179191300,1ptp4l401ktimersoftd/321:10:293
179191300,0ptp4l401ktimersoftd/322:20:513
21538992923,3cyclictest33-21ksoftirqd/201:15:402
21532992925,3cyclictest25-21ksoftirqd/101:36:211
21532992924,3cyclictest25-21ksoftirqd/123:06:081
21532992924,3cyclictest25-21ksoftirqd/122:20:581
21532992923,3cyclictest25-21ksoftirqd/123:31:201
21532992923,3cyclictest25-21ksoftirqd/102:16:211
21532992923,3cyclictest25-21ksoftirqd/100:31:031
21532992923,3cyclictest25-21ksoftirqd/100:22:361
21526992924,3cyclictest9-21ksoftirqd/002:16:380
21526992923,3cyclictest9-21ksoftirqd/022:20:410
179191290,1ptp4l401ktimersoftd/323:54:463
179191290,1ptp4l401ktimersoftd/323:54:463
8502280,4sleep02152699cyclictest21:16:110
216952280,4sleep341-21ksoftirqd/302:25:433
21546992822,3cyclictest41-21ksoftirqd/323:01:133
21538992823,3cyclictest33-21ksoftirqd/223:31:142
21538992823,3cyclictest33-21ksoftirqd/201:55:312
21532992823,3cyclictest25-21ksoftirqd/121:51:071
21532992823,3cyclictest25-21ksoftirqd/121:30:351
21532992823,3cyclictest25-21ksoftirqd/121:01:011
21532992823,3cyclictest25-21ksoftirqd/100:06:081
21532992822,3cyclictest25-21ksoftirqd/121:46:081
21532992819,5cyclictest25-21ksoftirqd/122:11:011
21526992822,3cyclictest9-21ksoftirqd/022:15:340
21526992822,3cyclictest9-21ksoftirqd/021:05:350
21526992821,4cyclictest9-21ksoftirqd/002:11:470
224792270,2sleep00-21swapper/020:56:030
21546992722,3cyclictest41-21ksoftirqd/301:56:153
21546992722,3cyclictest41-21ksoftirqd/300:26:143
21546992721,3cyclictest41-21ksoftirqd/321:11:533
21546992720,4cyclictest41-21ksoftirqd/321:23:363
21538992722,3cyclictest33-21ksoftirqd/201:43:172
21538992722,3cyclictest33-21ksoftirqd/201:43:172
21538992721,3cyclictest33-21ksoftirqd/223:21:202
21538992721,3cyclictest33-21ksoftirqd/221:14:482
21538992720,4cyclictest33-21ksoftirqd/221:07:462
21538992720,4cyclictest33-21ksoftirqd/201:29:212
21532992723,3cyclictest25-21ksoftirqd/121:06:041
21532992722,3cyclictest25-21ksoftirqd/122:31:121
21532992722,3cyclictest25-21ksoftirqd/101:15:411
21526992722,3cyclictest9-21ksoftirqd/000:08:380
21526992721,3cyclictest9-21ksoftirqd/022:46:520
21526992720,4cyclictest9-21ksoftirqd/000:51:020
2152699270,2cyclictest121rcu_preempt23:37:390
179191270,1ptp4l401ktimersoftd/322:41:143
179191270,1ptp4l401ktimersoftd/322:11:283
179191270,0ptp4l401ktimersoftd/322:39:183
33122260,5sleep02152699cyclictest01:18:110
21546992621,3cyclictest41-21ksoftirqd/321:36:383
21546992619,3cyclictest41-21ksoftirqd/323:36:013
21538992621,3cyclictest33-21ksoftirqd/201:05:222
21538992620,3cyclictest33-21ksoftirqd/202:03:012
21538992619,4cyclictest33-21ksoftirqd/222:17:552
21532992621,3cyclictest25-21ksoftirqd/122:35:381
21532992619,4cyclictest25-21ksoftirqd/123:39:041
21526992622,3cyclictest9-21ksoftirqd/000:41:160
21526992621,3cyclictest9-21ksoftirqd/021:26:050
21526992621,3cyclictest9-21ksoftirqd/000:26:050
21526992620,3cyclictest9-21ksoftirqd/002:21:230
21526992619,4cyclictest9-21ksoftirqd/022:39:370
21526992619,4cyclictest9-21ksoftirqd/022:02:150
21526992619,4cyclictest9-21ksoftirqd/022:02:150
21546992519,3cyclictest41-21ksoftirqd/320:56:353
21538992519,3cyclictest33-21ksoftirqd/221:43:502
21538992519,3cyclictest33-21ksoftirqd/221:17:272
21538992519,3cyclictest33-21ksoftirqd/201:06:452
21538992519,3cyclictest33-21ksoftirqd/200:04:442
21538992518,4cyclictest33-21ksoftirqd/222:08:562
21538992518,4cyclictest33-21ksoftirqd/222:00:292
21538992518,4cyclictest33-21ksoftirqd/222:00:292
21538992518,4cyclictest33-21ksoftirqd/221:40:212
21538992510,12cyclictest17720-21gltestperf01:36:072
21526992520,3cyclictest9-21ksoftirqd/023:56:130
21526992520,3cyclictest9-21ksoftirqd/022:35:230
21526992519,4cyclictest9-21ksoftirqd/021:34:540
21526992519,3cyclictest9-21ksoftirqd/023:53:350
21526992519,3cyclictest9-21ksoftirqd/023:53:350
21526992519,3cyclictest9-21ksoftirqd/000:10:470
21526992518,4cyclictest9-21ksoftirqd/023:33:130
21526992518,4cyclictest9-21ksoftirqd/021:50:310
21526992518,4cyclictest9-21ksoftirqd/001:28:150
2152699251,3cyclictest121rcu_preempt00:55:440
179191250,1ptp4l401ktimersoftd/322:10:373
179191250,0ptp4l401ktimersoftd/322:51:213
21546992417,4cyclictest41-21ksoftirqd/321:19:553
21538992419,3cyclictest33-21ksoftirqd/200:16:032
21538992418,4cyclictest13029-21grep00:11:242
21538992418,3cyclictest33-21ksoftirqd/220:57:242
21538992418,3cyclictest33-21ksoftirqd/200:29:552
21538992417,4cyclictest33-21ksoftirqd/223:13:352
21538992417,4cyclictest33-21ksoftirqd/223:01:072
21538992417,4cyclictest33-21ksoftirqd/222:37:582
21538992417,4cyclictest33-21ksoftirqd/221:26:532
21538992417,4cyclictest21723-21sed22:01:032
21538992417,4cyclictest21723-21sed22:01:032
2152699242,19cyclictest31830-21grep23:16:070
21526992419,3cyclictest9-21ksoftirqd/001:14:420
21526992418,4cyclictest9-21ksoftirqd/021:37:140
21526992418,3cyclictest9-21ksoftirqd/022:25:390
21526992418,3cyclictest9-21ksoftirqd/021:05:390
21526992418,3cyclictest9-21ksoftirqd/001:49:170
21526992417,4cyclictest9-21ksoftirqd/023:44:170
21526992417,4cyclictest9-21ksoftirqd/023:44:170
20452240,3sleep02152699cyclictest01:56:170
179191240,1ptp4l401ktimersoftd/322:31:043
179191240,1ptp4l401ktimersoftd/321:31:033
179191240,1ptp4l401ktimersoftd/302:01:213
21538992318,3cyclictest33-21ksoftirqd/223:36:282
21538992318,3cyclictest33-21ksoftirqd/202:10:452
21538992317,3cyclictest33-21ksoftirqd/222:25:422
21538992317,3cyclictest33-21ksoftirqd/222:25:262
21538992317,3cyclictest33-21ksoftirqd/201:21:512
21538992316,4cyclictest33-21ksoftirqd/222:58:202
21538992316,4cyclictest33-21ksoftirqd/222:54:322
21538992316,4cyclictest33-21ksoftirqd/222:42:122
21538992316,4cyclictest33-21ksoftirqd/221:01:272
21538992310,10cyclictest7062-21gltestperf21:31:052
21526992318,3cyclictest9-21ksoftirqd/023:26:140
21526992317,3cyclictest9-21ksoftirqd/022:17:280
21526992317,3cyclictest9-21ksoftirqd/021:58:540
21526992317,3cyclictest9-21ksoftirqd/021:58:540
21526992317,3cyclictest9-21ksoftirqd/000:50:330
21526992316,4cyclictest9-21ksoftirqd/000:32:340
21526992316,4cyclictest24353-21ssh01:44:120
21526992316,4cyclictest24353-21ssh01:44:120
21526992313,6cyclictest9-21ksoftirqd/001:06:000
2153899221,8cyclictest783-21ssh01:55:532
21538992217,3cyclictest33-21ksoftirqd/223:20:382
21538992216,4cyclictest33-21ksoftirqd/222:48:102
21538992216,3cyclictest33-21ksoftirqd/223:57:442
21538992216,3cyclictest33-21ksoftirqd/223:54:492
21538992216,3cyclictest33-21ksoftirqd/223:54:492
21538992216,3cyclictest24784-21snmp_o5powerctl23:06:102
21538992215,4cyclictest33-21ksoftirqd/222:11:412
2153899221,4cyclictest14637-21irqstats21:46:092
2153899221,3cyclictest15022-21users01:31:302
2153899220,19cyclictest4238-21gltestperf00:41:052
21526992217,3cyclictest9-21ksoftirqd/000:01:070
21526992215,4cyclictest9-21ksoftirqd/022:10:020
21526992215,4cyclictest31034-21latency_hist23:15:380
21526992215,4cyclictest1779-21runrttasks22:59:560
285882210,2sleep20-21swapper/200:31:122
2153899218,10cyclictest14844-21diskmemload02:22:562
21538992115,3cyclictest33-21ksoftirqd/200:46:052
21538992115,3cyclictest32224-21grep00:36:102
21538992114,4cyclictest16419-21/usr/sbin/munin00:56:252
21538992114,4cyclictest16322-21latency02:16:212
21538992114,4cyclictest1192-21gltestperf01:16:102
2153899211,18cyclictest8410-21ssh23:26:112
21526992116,3cyclictest9-21ksoftirqd/023:01:030
21526992115,4cyclictest12799-21threads21:41:150
21526992115,3cyclictest4981-21grep02:01:100
2152699210,18cyclictest0-21swapper/021:21:060
2153899201,4cyclictest23575-21apt-get23:46:022
21538992014,3cyclictest3240-21snmp_o5powerctl21:21:162
21538992013,4cyclictest17953-21seq21:52:562
21538992013,4cyclictest11146-21sh02:09:102
2153899201,17cyclictest0-21swapper/223:41:112
2153899201,17cyclictest0-21swapper/223:41:112
21526992015,3cyclictest9-21ksoftirqd/023:20:390
21526992015,3cyclictest9-21ksoftirqd/002:06:090
21526992014,4cyclictest9-21ksoftirqd/023:48:420
21526992014,3cyclictest9-21ksoftirqd/021:10:410
21526992013,4cyclictest31077-21vmstat01:51:290
21526992013,4cyclictest21689-21ls01:01:100
21538991913,3cyclictest27379-21sh01:46:442
21538991913,3cyclictest19578-21cat00:21:012
2153899191,15cyclictest7336-21apt-get00:06:012
21526991914,3cyclictest9-21ksoftirqd/001:24:480
21526991914,3cyclictest19379-21sh01:37:120
21526991913,4cyclictest13127-21/usr/sbin/munin01:31:290
21526991913,3cyclictest7515-21latency_hist22:40:380
21526991913,3cyclictest19648-21sh00:21:020
21526991912,4cyclictest14844-21diskmemload00:20:350
21526991812,3cyclictest9-21ksoftirqd/000:36:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional