You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 03:47

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot5.osadl.org (updated Sun Dec 04, 2022 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25653762345304,11sleep60-21swapper/619:05:2312
25654292340302,27sleep50-21swapper/519:06:1111
25624082338332,3sleep130-21swapper/1319:03:225
25655412333315,10sleep80-21swapper/819:07:3414
25653322331323,5sleep00-21swapper/019:04:450
25652802331312,10sleep20-21swapper/219:03:598
25653392328309,10sleep40-21swapper/419:04:4910
25652732328316,6sleep120-21swapper/1219:03:534
25624032328308,11sleep100-21swapper/1019:03:192
25655852327309,10sleep110-21swapper/1119:08:093
25654602327306,11sleep140-21swapper/1419:06:366
25654332327309,10sleep90-21swapper/919:06:1515
25653922326306,10sleep30-21swapper/319:05:369
25653712326307,10sleep10-21swapper/119:05:181
25652682326307,11sleep70-21swapper/719:03:4813
25653502325306,10sleep150-21swapper/1519:05:007
256592199437,11cyclictest0-21swapper/1223:36:284
256592199437,11cyclictest0-21swapper/1221:35:394
256592199437,11cyclictest0-21swapper/1200:09:254
256592199415,11cyclictest0-21swapper/1200:20:244
256592199240,0cyclictest0-21swapper/1223:14:304
256592199230,23cyclictest0-21swapper/1221:13:414
256591999230,13cyclictest0-21swapper/1120:50:123
256592199209,11cyclictest0-21swapper/1223:03:314
2565896992010,10cyclictest0-21swapper/620:09:1312
256592199199,0cyclictest0-21swapper/1220:23:124
256592199198,11cyclictest0-21swapper/1223:25:294
256592199198,11cyclictest0-21swapper/1222:19:354
256592199198,11cyclictest0-21swapper/1222:08:364
256592199198,11cyclictest0-21swapper/1221:24:404
256592199198,11cyclictest0-21swapper/1221:02:424
256592199198,11cyclictest0-21swapper/1220:40:444
256592199198,11cyclictest0-21swapper/1220:40:444
256592199198,11cyclictest0-21swapper/1220:07:474
256592199198,11cyclictest0-21swapper/1219:56:484
2565910991919,0cyclictest1454-21snmpd22:27:2515
256589699199,10cyclictest0-21swapper/623:16:1312
256589699190,16cyclictest0-21swapper/623:09:4712
256592199188,10cyclictest0-21swapper/1220:29:454
256592199188,10cyclictest0-21swapper/1220:29:454
256592199187,11cyclictest0-21swapper/1223:58:264
256592199187,11cyclictest0-21swapper/1223:47:274
256592199187,11cyclictest0-21swapper/1222:41:334
256592199187,11cyclictest0-21swapper/1221:57:374
256592199187,11cyclictest0-21swapper/1221:46:384
256592199187,11cyclictest0-21swapper/1220:51:434
256592199187,11cyclictest0-21swapper/1219:45:494
256592199187,11cyclictest0-21swapper/1219:34:504
256592199187,11cyclictest0-21swapper/1219:23:514
256592199187,11cyclictest0-21swapper/1219:12:524
256591499183,2cyclictest0-21swapper/1023:41:112
2565900991810,3cyclictest2709326-21/usr/sbin/munin21:48:2713
2565896991814,4cyclictest1454-21snmpd22:19:5512
256589699180,16cyclictest0-21swapper/619:16:5112
256589299188,10cyclictest0-21swapper/523:44:1311
256589299188,10cyclictest0-21swapper/523:25:1311
256588999188,10cyclictest712165-21Xorg19:34:1310
256588699188,10cyclictest0-21swapper/322:11:139
139099180,1ntpd32-21ksoftirqd/220:50:228
256593399171,0cyclictest0-21swapper/1521:17:267
256593399170,0cyclictest0-21swapper/1521:32:307
256592999170,17cyclictest0-21swapper/1423:54:036
2565925991713,4cyclictest0-21swapper/1320:33:415
2565925991713,4cyclictest0-21swapper/1320:33:415
256592599170,17cyclictest0-21swapper/1323:44:355
256592199177,10cyclictest0-21swapper/1222:52:324
256592199177,10cyclictest0-21swapper/1222:30:344
256592199177,10cyclictest0-21swapper/1200:31:234
256592199170,0cyclictest0-21swapper/1222:14:524
256591999177,10cyclictest0-21swapper/1121:00:123
256591999177,10cyclictest0-21swapper/1119:19:123
256591999177,0cyclictest0-21swapper/1100:33:133
256591999173,8cyclictest0-21swapper/1123:55:273
256591999170,14cyclictest0-21swapper/1123:42:353
256591999170,14cyclictest0-21swapper/1122:55:523
256591999170,14cyclictest0-21swapper/1121:27:233
2565914991716,1cyclictest1454-21snmpd22:00:512
256591499170,15cyclictest0-21swapper/1019:45:422
256591499170,14cyclictest0-21swapper/1019:48:272
256591099170,14cyclictest0-21swapper/900:35:1615
2565903991716,1cyclictest1454-21snmpd19:49:0614
256590099170,0cyclictest0-21swapper/719:20:1813
2565896991716,1cyclictest1454-21snmpd21:56:0912
2565896991711,6cyclictest1454-21snmpd22:15:1612
256589699170,0cyclictest0-21swapper/621:36:0612
2565892991716,1cyclictest1454-21snmpd21:53:4211
2565892991716,1cyclictest1454-21snmpd00:03:3011
2565889991716,1cyclictest1454-21snmpd21:08:4410
256588999170,14cyclictest0-21swapper/422:37:1310
256588999170,14cyclictest0-21swapper/419:16:4210
256588199170,17cyclictest0-21swapper/200:29:348
2565933991615,1cyclictest1454-21snmpd22:14:137
2565933991615,1cyclictest1454-21snmpd19:57:487
2565933991615,1cyclictest1454-21snmpd19:38:457
2565933991614,2cyclictest1454-21snmpd22:39:557
2565933991614,2cyclictest1454-21snmpd21:46:337
2565933991614,2cyclictest1454-21snmpd20:10:557
256593399160,16cyclictest0-21swapper/1523:20:147
256593399160,14cyclictest0-21swapper/1523:55:007
256593399160,13cyclictest0-21swapper/1521:12:057
256593399160,13cyclictest0-21swapper/1500:25:527
2565929991615,1cyclictest1454-21snmpd23:10:446
256592999160,16cyclictest0-21swapper/1422:53:076
256592999160,16cyclictest0-21swapper/1422:43:076
256592999160,13cyclictest0-21swapper/1419:13:426
256592999160,0cyclictest0-21swapper/1423:51:536
256592999160,0cyclictest0-21swapper/1421:56:066
256592999160,0cyclictest0-21swapper/1421:29:266
2565925991613,3cyclictest0-21swapper/1300:24:055
2565925991613,0cyclictest0-21swapper/1323:49:575
2565925991613,0cyclictest0-21swapper/1322:37:255
2565925991613,0cyclictest0-21swapper/1321:59:015
2565925991612,4cyclictest0-21swapper/1320:21:195
2565925991612,0cyclictest0-21swapper/1323:07:175
256592599160,16cyclictest0-21swapper/1322:39:165
256592599160,16cyclictest0-21swapper/1322:21:585
256592599160,16cyclictest0-21swapper/1321:10:535
256592599160,16cyclictest0-21swapper/1319:53:215
256592599160,13cyclictest0-21swapper/1323:11:175
256592599160,13cyclictest0-21swapper/1320:12:215
2565921991614,2cyclictest1454-21snmpd19:17:574
256592199160,0cyclictest0-21swapper/1222:35:194
2565919991616,0cyclictest1454-21snmpd00:33:193
2565919991614,2cyclictest1454-21snmpd22:46:433
2565919991610,3cyclictest0-21swapper/1122:33:403
256591999160,16cyclictest0-21swapper/1120:03:073
256591999160,13cyclictest0-21swapper/1123:25:203
256591999160,0cyclictest0-21swapper/1120:16:523
2565914991615,1cyclictest1454-21snmpd20:16:312
2565914991614,2cyclictest1454-21snmpd21:15:592
2565914991610,3cyclictest0-21swapper/1023:25:472
2565914991610,3cyclictest0-21swapper/1021:01:262
2565914991610,3cyclictest0-21swapper/1020:50:232
2565914991610,3cyclictest0-21swapper/1020:32:252
2565914991610,3cyclictest0-21swapper/1020:32:252
256591499160,13cyclictest0-21swapper/1022:25:132
256591099163,7cyclictest0-21swapper/919:29:1015
2565910991610,3cyclictest0-21swapper/923:04:5615
2565910991610,3cyclictest0-21swapper/922:11:1815
256591099160,13cyclictest0-21swapper/921:24:5315
256591099160,13cyclictest0-21swapper/919:55:4515
256591099160,0cyclictest0-21swapper/900:19:2715
256590099166,10cyclictest0-21swapper/723:58:1313
2565900991615,1cyclictest1454-21snmpd22:24:2213
2565900991614,2cyclictest1454-21snmpd23:19:0213
2565900991614,2cyclictest1454-21snmpd21:15:4713
2565900991614,2cyclictest1454-21snmpd00:26:3413
2565900991610,3cyclictest0-21swapper/719:37:4813
256590099160,0cyclictest0-21swapper/720:50:5313
256590099160,0cyclictest0-21swapper/720:20:3413
256589699166,10cyclictest0-21swapper/619:49:1312
2565896991615,1cyclictest1454-21snmpd23:47:4712
2565896991615,1cyclictest1454-21snmpd22:05:2112
2565896991614,2cyclictest1454-21snmpd23:49:2012
2565896991614,2cyclictest1454-21snmpd00:22:0012
2565896991612,4cyclictest1454-21snmpd22:41:4912
2565896991610,3cyclictest0-21swapper/619:40:1212
256589699160,0cyclictest0-21swapper/623:01:0112
2565892991616,0cyclictest1454-21snmpd20:09:3711
2565892991615,1cyclictest1454-21snmpd19:35:5111
2565892991614,2cyclictest1454-21snmpd22:08:0611
256589299160,16cyclictest0-21swapper/521:46:2411
256589299160,16cyclictest0-21swapper/520:36:1611
256589299160,16cyclictest0-21swapper/520:36:1611
256589299160,13cyclictest0-21swapper/520:46:1011
256589299160,13cyclictest0-21swapper/520:46:1011
256588999166,10cyclictest0-21swapper/419:09:1310
2565889991615,1cyclictest1454-21snmpd21:24:2310
2565889991614,2cyclictest1454-21snmpd19:32:4210
256588699166,0cyclictest0-21swapper/323:34:139
2565886991616,0cyclictest1454-21snmpd00:21:579
256588699160,16cyclictest0-21swapper/300:04:009
256588699160,13cyclictest0-21swapper/319:26:099
256588699160,0cyclictest0-21swapper/322:47:529
2565881991616,0cyclictest1454-21snmpd22:28:438
2565881991616,0cyclictest1454-21snmpd21:44:428
2565881991615,1cyclictest1454-21snmpd21:25:028
256588199160,16cyclictest0-21swapper/222:44:468
256588199160,0cyclictest0-21swapper/221:13:298
2565877991610,3cyclictest0-21swapper/100:09:571
256587799160,13cyclictest0-21swapper/120:14:161
256587799160,13cyclictest0-21swapper/119:10:181
2565873991615,1cyclictest1454-21snmpd20:53:260
2565873991615,1cyclictest1454-21snmpd19:21:480
2565873991614,2cyclictest1454-21snmpd22:24:100
256587399160,16cyclictest0-21swapper/021:42:150
256587399160,0cyclictest0-21swapper/021:30:110
139099160,1ntpd32-21ksoftirqd/221:07:428
139099160,1ntpd32-21ksoftirqd/219:39:328
256593399155,0cyclictest0-21swapper/1521:01:137
2565933991514,1cyclictest1454-21snmpd20:43:167
2565933991514,1cyclictest1454-21snmpd20:43:167
2565933991513,2cyclictest1454-21snmpd21:19:087
256593399150,15cyclictest0-21swapper/1522:53:377
256593399150,12cyclictest0-21swapper/1521:39:247
256592999155,10cyclictest0-21swapper/1423:40:116
2565929991510,2cyclictest0-21swapper/1423:17:296
2565929991510,2cyclictest0-21swapper/1422:05:216
256592999150,15cyclictest0-21swapper/1419:13:096
256592999150,12cyclictest0-21swapper/1423:46:236
256592999150,0cyclictest0-21swapper/1423:19:506
2565925991514,1cyclictest1454-21snmpd20:38:165
2565925991514,1cyclictest1454-21snmpd20:38:165
2565925991512,0cyclictest0-21swapper/1320:29:255
2565925991512,0cyclictest0-21swapper/1320:29:255
2565925991510,3cyclictest0-21swapper/1323:23:135
2565925991510,2cyclictest0-21swapper/1321:53:455
2565925991510,2cyclictest0-21swapper/1300:38:135
256592599150,15cyclictest0-21swapper/1319:36:095
256592199155,0cyclictest0-21swapper/1220:13:124
2565921991514,1cyclictest1454-21snmpd23:08:474
2565921991513,1cyclictest1203-21lldpd23:52:284
2565921991510,2cyclictest0-21swapper/1220:02:074
256592199150,12cyclictest0-21swapper/1220:37:464
256592199150,12cyclictest0-21swapper/1220:37:464
256592199150,12cyclictest0-21swapper/1220:17:584
256591999150,15cyclictest0-21swapper/1119:50:333
256591499159,3cyclictest0-21swapper/1000:12:422
2565914991514,1cyclictest2679615-21cat21:23:282
2565914991513,2cyclictest1454-21snmpd00:32:042
2565914991512,3cyclictest1454-21snmpd22:46:012
256591499150,15cyclictest0-21swapper/1021:43:392
256591499150,15cyclictest0-21swapper/1021:41:572
256591499150,12cyclictest0-21swapper/1020:57:202
256591499150,0cyclictest0-21swapper/1021:04:172
256591099159,3cyclictest0-21swapper/921:22:1415
256591099159,3cyclictest0-21swapper/919:45:1815
2565910991515,0cyclictest1454-21snmpd22:18:1615
2565910991515,0cyclictest1454-21snmpd19:27:0015
2565910991514,1cyclictest1454-21snmpd21:59:5115
2565910991514,1cyclictest1454-21snmpd20:12:1915
256591099150,0cyclictest0-21swapper/919:58:2715
2565903991515,0cyclictest1454-21snmpd21:55:4514
2565903991515,0cyclictest1454-21snmpd21:42:2714
2565903991514,1cyclictest1454-21snmpd23:49:4714
2565903991514,1cyclictest1454-21snmpd21:30:1114
2565900991514,1cyclictest1454-21snmpd23:15:4413
2565900991513,1cyclictest10788-21CPU13
256590099150,15cyclictest0-21swapper/700:35:5213
2565896991514,1cyclictest1454-21snmpd22:56:4312
2565896991514,1cyclictest1454-21snmpd21:38:3312
2565896991514,1cyclictest1454-21snmpd19:12:5412
2565896991513,2cyclictest1454-21snmpd20:40:2812
2565896991513,2cyclictest1454-21snmpd20:40:2812
256589699150,15cyclictest0-21swapper/600:23:3912
256589299159,3cyclictest0-21swapper/520:42:2511
256589299159,3cyclictest0-21swapper/520:42:2511
256589299159,3cyclictest0-21swapper/520:25:0411
2565892991513,2cyclictest1454-21snmpd22:41:0111
2565892991510,2cyclictest0-21swapper/519:10:5411
256589299150,15cyclictest0-21swapper/500:14:4211
256589299150,0cyclictest0-21swapper/522:37:4311
2565889991514,1cyclictest1454-21snmpd23:07:0510
2565889991513,2cyclictest1454-21snmpd22:01:2710
256588999150,15cyclictest0-21swapper/420:43:5510
256588999150,15cyclictest0-21swapper/420:43:5510
256588999150,15cyclictest0-21swapper/420:34:1010
256588999150,15cyclictest0-21swapper/420:34:1010
256588999150,12cyclictest0-21swapper/400:13:3610
256588999150,0cyclictest0-21swapper/420:20:1910
256588699159,3cyclictest0-21swapper/320:44:289
256588699159,3cyclictest0-21swapper/320:44:289
2565886991515,0cyclictest1454-21snmpd20:03:259
2565886991514,1cyclictest1454-21snmpd22:32:319
2565886991514,1cyclictest1454-21snmpd00:13:189
2565886991513,2cyclictest1454-21snmpd23:38:389
2565881991515,0cyclictest1454-21snmpd23:37:568
2565881991515,0cyclictest1454-21snmpd21:02:238
2565881991515,0cyclictest1454-21snmpd19:43:338
2565881991514,1cyclictest1454-21snmpd23:06:418
2565881991514,1cyclictest1454-21snmpd22:26:378
2565881991514,1cyclictest1454-21snmpd22:10:218
2565881991514,1cyclictest1454-21snmpd20:32:228
2565881991514,1cyclictest1454-21snmpd20:32:228
256588199150,15cyclictest0-21swapper/220:15:378
2565877991515,0cyclictest1454-21snmpd19:59:391
2565877991515,0cyclictest0-21swapper/122:27:251
2565877991514,1cyclictest1454-21snmpd23:37:501
2565877991514,1cyclictest1454-21snmpd21:25:351
2565877991514,1cyclictest1454-21snmpd20:49:561
2565877991514,1cyclictest1454-21snmpd19:57:031
2565877991510,3cyclictest0-21swapper/119:29:121
2565877991510,3cyclictest0-21swapper/119:27:211
256587799150,15cyclictest0-21swapper/122:28:581
256587799150,0cyclictest0-21swapper/122:45:401
2565873991513,2cyclictest1454-21snmpd19:36:570
256587399150,15cyclictest0-21swapper/023:56:240
256587399150,15cyclictest0-21swapper/019:46:240
139099150,1ntpd32-21ksoftirqd/219:56:478
2565933991414,0cyclictest28420091kworker/u32:123:41:137
2565933991414,0cyclictest1454-21snmpd19:37:247
2565933991413,1cyclictest1454-21snmpd21:51:307
2565933991413,1cyclictest1454-21snmpd19:20:367
2565933991413,1cyclictest1454-21snmpd00:34:347
2565933991412,2cyclictest1454-21snmpd23:33:147
2565933991412,2cyclictest1454-21snmpd20:50:327
2565933991412,2cyclictest1454-21snmpd20:19:377
256593399140,14cyclictest0-21swapper/1523:58:337
256593399140,14cyclictest0-21swapper/1523:13:597
256593399140,14cyclictest0-21swapper/1500:09:247
256593399140,0cyclictest0-21swapper/1522:23:227
256593399140,0cyclictest0-21swapper/1520:07:137
2565929991413,1cyclictest1454-21snmpd23:00:346
256592999140,14cyclictest0-21swapper/1422:21:046
256592999140,11cyclictest0-21swapper/1421:33:396
256592999140,0cyclictest0-21swapper/1422:31:376
256592999140,0cyclictest0-21swapper/1422:14:496
2565925991413,1cyclictest1454-21snmpd22:48:465
2565925991413,1cyclictest1454-21snmpd21:46:395
2565925991411,3cyclictest0-21swapper/1323:54:135
2565925991411,3cyclictest0-21swapper/1321:16:215
2565925991410,4cyclictest0-21swapper/1321:07:495
2565925991410,0cyclictest0-21swapper/1319:08:215
256592599140,14cyclictest0-21swapper/1322:58:195
256592599140,11cyclictest0-21swapper/1323:24:215
256592199140,14cyclictest0-21swapper/1223:38:264
256592199140,14cyclictest0-21swapper/1222:59:344
256592199140,14cyclictest0-21swapper/1222:06:424
256591999140,14cyclictest0-21swapper/1122:32:163
256591999140,14cyclictest0-21swapper/1121:10:113
256591999140,14cyclictest0-21swapper/1119:25:123
256591999140,14cyclictest0-21swapper/1100:21:213
256591999140,14cyclictest0-21swapper/1100:02:573
256591999140,11cyclictest0-21swapper/1100:03:213
256591499140,14cyclictest0-21swapper/1021:53:132
256591499140,0cyclictest0-21swapper/1023:06:202
2565910991413,1cyclictest1454-21snmpd22:44:4915
256591099140,14cyclictest0-21swapper/921:00:0815
256591099140,11cyclictest0-21swapper/921:03:4115
2565903991414,0cyclictest1454-21snmpd22:43:3414
2565903991413,1cyclictest1454-21snmpd00:07:0014
2565903991412,2cyclictest1454-21snmpd23:20:4414
256590399140,0cyclictest0-21swapper/800:03:0614
2565900991414,0cyclictest1454-21snmpd21:39:5713
2565900991413,1cyclictest1454-21snmpd23:49:1413
2565900991413,1cyclictest1454-21snmpd21:37:0013
2565900991413,1cyclictest1454-21snmpd21:11:3213
2565900991413,1cyclictest1454-21snmpd20:07:1013
2565900991410,2cyclictest0-21swapper/721:18:5913
256590099140,11cyclictest0-21swapper/723:01:5913
256590099140,11cyclictest0-21swapper/720:23:3413
256590099140,0cyclictest0-21swapper/721:46:5413
256590099140,0cyclictest0-21swapper/719:56:2113
2565896991413,1cyclictest1454-21snmpd19:35:3312
2565896991412,2cyclictest1454-21snmpd21:28:3812
2565896991410,4cyclictest1454-21snmpd22:51:5512
256589699140,14cyclictest0-21swapper/623:03:4712
256589699140,14cyclictest0-21swapper/620:46:5812
256589699140,14cyclictest0-21swapper/620:46:5812
256589699140,14cyclictest0-21swapper/620:24:3712
2565892991414,0cyclictest27408571kworker/u32:122:16:1311
2565892991414,0cyclictest25961301kworker/u32:020:04:1311
2565892991413,1cyclictest1454-21snmpd22:01:5711
2565892991413,1cyclictest1454-21snmpd21:52:5411
256589299140,14cyclictest0-21swapper/523:48:1311
256589299140,14cyclictest0-21swapper/522:47:5511
256589299140,11cyclictest0-21swapper/523:10:0211
2565889991413,1cyclictest1454-21snmpd22:49:4310
2565889991413,1cyclictest1454-21snmpd22:04:0910
2565889991413,1cyclictest1454-21snmpd21:28:5010
2565889991413,1cyclictest1454-21snmpd20:05:1610
2565889991412,2cyclictest1454-21snmpd21:52:3010
256588999140,11cyclictest0-21swapper/423:28:2910
2565886991414,0cyclictest1454-21snmpd22:36:259
2565886991412,2cyclictest1454-21snmpd21:03:059
256588699140,14cyclictest0-21swapper/319:28:189
256588699140,14cyclictest0-21swapper/300:32:559
2565881991414,0cyclictest291irq_work/221:41:138
2565881991413,1cyclictest1454-21snmpd23:38:598
2565881991413,1cyclictest1454-21snmpd23:26:478
2565881991413,1cyclictest1454-21snmpd22:18:588
2565881991413,1cyclictest1454-21snmpd19:48:278
2565881991413,1cyclictest1454-21snmpd00:12:428
256588199140,1cyclictest2898149-21sed00:28:138
2565877991413,1cyclictest1454-21snmpd23:59:061
2565877991413,1cyclictest1454-21snmpd00:18:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional