You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 01:45

x86 Intel Core i3-4360 CPU @3700 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot4.osadl.org (updated Mon Jun 27, 2022 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
221119210561,13sleep10-21swapper/119:07:181
22116729562,20sleep00-21swapper/019:07:540
22126328565,13sleep20-21swapper/219:09:082
22059728362,14sleep30-21swapper/319:05:243
221428997011,31cyclictest0-21swapper/020:37:080
22142899250,25cyclictest0-21swapper/020:57:320
22143499240,23cyclictest0-21swapper/222:43:392
22143299240,24cyclictest0-21swapper/100:04:501
22143299240,15cyclictest0-21swapper/119:20:051
22143899231,15cyclictest0-21swapper/321:26:583
22143899220,13cyclictest0-21swapper/323:27:453
22143499210,12cyclictest0-21swapper/221:35:162
221434992011,9cyclictest0-21swapper/221:14:032
221434992011,9cyclictest0-21swapper/221:14:032
22143499200,4cyclictest0-21swapper/223:21:142
221432992011,9cyclictest0-21swapper/123:34:231
221428992011,9cyclictest0-21swapper/023:22:530
221428992011,9cyclictest0-21swapper/021:11:000
221428992011,9cyclictest0-21swapper/021:11:000
22142899200,4cyclictest0-21swapper/022:22:030
221434991815,2cyclictest1024-21snmpd22:22:542
221434991810,8cyclictest0-21swapper/223:19:322
22143499180,4cyclictest0-21swapper/220:04:182
22143299180,2cyclictest0-21swapper/121:51:041
22142899183,6cyclictest447138-21ssh00:36:040
22143499172,6cyclictest0-21swapper/200:01:152
22143499170,2cyclictest0-21swapper/220:08:032
22143499170,1cyclictest0-21swapper/222:57:122
22143299170,1cyclictest0-21swapper/123:41:431
110699170,2ntpd33-21ksoftirqd/219:46:162
22143899161,6cyclictest0-21swapper/319:57:063
22143899160,8cyclictest404389-21timerwakeupswit23:45:203
22143899160,7cyclictest0-21swapper/321:23:543
22143899160,11cyclictest0-21swapper/321:55:233
22143499161,6cyclictest439898-21ssh00:28:242
221434991614,1cyclictest1024-21snmpd23:14:002
22143499160,7cyclictest442949-21ssh00:31:062
22143499160,7cyclictest425828-21ssh00:10:382
22143499160,7cyclictest0-21swapper/221:07:452
22143499160,6cyclictest342615-21ssh22:32:542
22143499160,1cyclictest0-21swapper/220:30:042
22143499160,16cyclictest0-21swapper/219:14:242
22143499160,15cyclictest0-21swapper/221:47:012
22143299168,8cyclictest0-21swapper/122:01:531
22143299160,1cyclictest0-21swapper/122:09:111
22143299160,1cyclictest0-21swapper/119:58:241
22143299160,1cyclictest0-21swapper/119:43:241
22143299160,1cyclictest0-21swapper/100:06:571
22143299160,16cyclictest0-21swapper/123:51:001
22143299160,16cyclictest0-21swapper/123:16:441
22143299160,16cyclictest0-21swapper/123:09:161
22143299160,16cyclictest0-21swapper/120:49:051
22143299160,16cyclictest0-21swapper/119:53:151
22143299160,16cyclictest0-21swapper/119:28:231
22142899160,7cyclictest0-21swapper/019:53:180
22142899160,7cyclictest0-21swapper/000:22:400
22142899160,1cyclictest0-21swapper/020:25:280
22142899160,16cyclictest0-21swapper/000:17:480
110699160,1ntpd33-21ksoftirqd/220:39:122
22143899156,9cyclictest0-21swapper/321:43:253
221438991510,1cyclictest265065-21sort20:50:203
22143899150,15cyclictest0-21swapper/300:38:263
22143899150,0cyclictest0-21swapper/323:19:203
221434991513,1cyclictest1024-21snmpd22:52:012
22143499150,15cyclictest0-21swapper/222:25:032
22143499150,15cyclictest0-21swapper/220:52:142
22143499150,15cyclictest0-21swapper/220:28:552
22143299150,6cyclictest0-21swapper/100:20:071
22143299150,15cyclictest0-21swapper/121:40:401
22143299150,15cyclictest0-21swapper/120:57:351
22143299150,0cyclictest0-21swapper/121:32:221
22143299150,0cyclictest0-21swapper/121:21:061
22143299150,0cyclictest0-21swapper/100:35:251
221428991515,0cyclictest383754-21kworker/u8:023:40:370
22142899150,7cyclictest0-21swapper/023:33:400
22142899150,15cyclictest0-21swapper/021:45:310
22142899150,15cyclictest0-21swapper/020:01:450
22142899150,0cyclictest0-21swapper/022:43:530
22142899150,0cyclictest0-21swapper/019:17:140
110699150,2ntpd33-21ksoftirqd/220:21:242
110699150,2ntpd33-21ksoftirqd/219:28:532
221438991413,1cyclictest1024-21snmpd22:34:363
22143899140,5cyclictest0-21swapper/322:13:533
22143899140,5cyclictest0-21swapper/320:41:113
22143899140,5cyclictest0-21swapper/300:32:423
22143899140,14cyclictest0-21swapper/323:54:593
22143899140,0cyclictest0-21swapper/322:09:163
22143499143,10cyclictest0-21swapper/220:59:482
221434991412,1cyclictest1024-21snmpd21:02:092
22143499140,6cyclictest0-21swapper/221:34:432
22143499140,5cyclictest0-21swapper/220:45:172
22143499140,5cyclictest0-21swapper/200:16:182
221432991412,1cyclictest1024-21snmpd22:13:531
22143299140,14cyclictest0-21swapper/120:29:371
22143299140,14cyclictest0-21swapper/100:18:511
221428991413,1cyclictest1024-21snmpd21:29:400
221428991413,1cyclictest1024-21snmpd20:08:180
22142899140,5cyclictest0-21swapper/022:06:140
221438991312,1cyclictest1024-21snmpd23:04:343
22143899130,0cyclictest0-21swapper/319:30:173
22143499133,9cyclictest227404-21ntp_states19:20:172
22143499130,1cyclictest386598-21ssh23:25:192
22143499130,1cyclictest0-21swapper/223:35:202
22143499130,13cyclictest0-21swapper/220:10:042
22143299130,1cyclictest0-21swapper/120:00:121
221438991211,1cyclictest1024-21snmpd20:22:073
221438991211,1cyclictest0-21swapper/323:12:153
221438991211,1cyclictest0-21swapper/321:31:283
22143899120,4cyclictest0-21swapper/322:42:573
22143499129,2cyclictest391092-21cat23:30:142
22143499122,9cyclictest0-21swapper/200:07:502
221434991210,1cyclictest1024-21snmpd19:53:272
22143499120,3cyclictest0-21swapper/219:16:592
22143299129,2cyclictest1024-21snmpd23:49:001
221432991211,1cyclictest1024-21snmpd19:16:231
221432991210,1cyclictest1024-21snmpd22:59:061
221432991210,1cyclictest1024-21snmpd20:36:591
221432991210,1cyclictest1024-21snmpd20:33:351
221432991210,1cyclictest1024-21snmpd20:18:461
22143299120,0cyclictest0-21swapper/122:25:201
22142899123,9cyclictest0-21swapper/023:04:430
22142899123,9cyclictest0-21swapper/021:52:100
22142899123,9cyclictest0-21swapper/000:28:330
221428991211,1cyclictest1024-21snmpd20:49:020
221428991211,1cyclictest1024-21snmpd19:11:470
22143899116,5cyclictest271104-21ntpq21:05:173
22143899112,9cyclictest0-21swapper/321:39:013
22143899112,9cyclictest0-21swapper/319:24:443
22143499119,1cyclictest1024-21snmpd21:50:332
22143499119,1cyclictest1024-21snmpd21:26:372
22143499119,1cyclictest1024-21snmpd21:24:482
22143499119,1cyclictest1024-21snmpd21:18:362
22143499119,1cyclictest1024-21snmpd19:31:592
22143499119,1cyclictest1024-21snmpd00:36:462
22143499110,10cyclictest0-21swapper/223:50:182
22143499110,10cyclictest0-21swapper/222:03:392
22143299119,1cyclictest1024-21snmpd23:21:261
22143299119,1cyclictest1024-21snmpd22:16:321
22143299119,1cyclictest1024-21snmpd21:58:171
22143299119,1cyclictest1024-21snmpd19:12:261
22143299113,8cyclictest0-21swapper/121:12:061
22143299113,8cyclictest0-21swapper/121:12:061
22143299113,8cyclictest0-21swapper/119:32:411
22143299112,9cyclictest0-21swapper/123:35:261
22143299112,9cyclictest0-21swapper/123:26:371
22143299112,9cyclictest0-21swapper/100:13:151
221432991110,1cyclictest1024-21snmpd21:05:331
221432991110,1cyclictest1024-21snmpd20:13:131
22143299110,1cyclictest0-21swapper/119:45:171
22143299110,11cyclictest0-21swapper/100:25:221
22142899119,2cyclictest250057-21cat20:15:140
22142899119,1cyclictest1024-21snmpd22:55:150
22142899119,1cyclictest1024-21snmpd22:48:490
22142899119,1cyclictest1024-21snmpd22:30:330
22142899119,1cyclictest1024-21snmpd22:15:170
22142899119,1cyclictest1024-21snmpd21:32:160
22142899119,1cyclictest1024-21snmpd19:20:110
22142899119,1cyclictest1024-21snmpd00:14:090
22142899118,2cyclictest241702-21cat19:55:130
22142899118,1cyclictest843-21irqbalance20:50:230
22142899112,9cyclictest0-21swapper/023:28:550
22142899112,9cyclictest0-21swapper/021:22:090
22142899112,0cyclictest0-21swapper/023:19:170
221428991111,0cyclictest0-21swapper/019:46:390
221428991110,1cyclictest1024-21snmpd22:27:050
22142899110,1cyclictest0-21swapper/023:35:200
110699110,5ntpd311284-21ntpq21:55:170
22143899109,1cyclictest1024-21snmpd23:35:133
22143899109,1cyclictest1024-21snmpd22:29:213
22143899109,1cyclictest1024-21snmpd21:47:553
22143899109,1cyclictest1024-21snmpd20:15:403
22143899109,1cyclictest1024-21snmpd20:01:393
22143899109,1cyclictest1024-21snmpd19:48:303
22143899101,9cyclictest0-21swapper/322:19:393
22143899101,9cyclictest0-21swapper/300:00:033
22143899100,9cyclictest0-21swapper/320:25:143
22143899100,4cyclictest0-21swapper/320:33:473
22143899100,10cyclictest0-21swapper/323:31:503
22143899100,10cyclictest0-21swapper/323:24:193
22143899100,10cyclictest0-21swapper/320:14:553
22143499109,1cyclictest1024-21snmpd00:24:342
22143499108,1cyclictest1024-21snmpd22:10:532
22143499105,1cyclictest415358-21ssh23:59:592
22143499105,1cyclictest0-21swapper/219:35:022
22143499100,9cyclictest0-21swapper/221:58:262
22143499100,1cyclictest0-21swapper/222:15:142
22143299109,1cyclictest1024-21snmpd21:46:251
22143299108,1cyclictest1024-21snmpd22:30:481
22143299108,1cyclictest1024-21snmpd20:41:111
22143299107,2cyclictest1024-21snmpd21:18:211
22143299105,1cyclictest0-21swapper/123:11:451
22143299105,1cyclictest0-21swapper/121:25:061
22143299101,9cyclictest0-21swapper/122:40:051
22143299100,9cyclictest1956-21llvmpipe-220:52:591
22143299100,1cyclictest0-21swapper/122:52:461
22142899109,1cyclictest1024-21snmpd23:10:450
22142899109,1cyclictest1024-21snmpd21:43:280
22142899109,1cyclictest1024-21snmpd20:10:130
22142899109,1cyclictest1024-21snmpd19:41:120
22142899109,1cyclictest1024-21snmpd00:01:110
22142899109,1cyclictest0-21swapper/023:48:320
22142899109,1cyclictest0-21swapper/022:03:110
22142899109,1cyclictest0-21swapper/000:32:390
22142899101,9cyclictest0-21swapper/019:26:050
22142899100,10cyclictest0-21swapper/023:51:300
22142899100,10cyclictest0-21swapper/020:33:410
22142899100,10cyclictest0-21swapper/019:35:590
110699100,5ntpd353458-21ntpq22:45:182
2214389999,0cyclictest0-21swapper/320:08:463
2214389998,1cyclictest1024-21snmpd23:41:043
2214389998,1cyclictest1024-21snmpd23:08:333
2214389998,1cyclictest1024-21snmpd21:15:063
2214389998,1cyclictest1024-21snmpd21:12:513
2214389998,1cyclictest1024-21snmpd21:12:513
2214389998,1cyclictest1024-21snmpd20:56:413
2214389990,9cyclictest0-21swapper/322:35:053
2214389990,9cyclictest0-21swapper/321:01:003
2214389990,9cyclictest0-21swapper/320:49:503
2214389990,9cyclictest0-21swapper/319:16:443
2214389990,9cyclictest0-21swapper/319:13:143
2214389990,9cyclictest0-21swapper/300:29:033
2214389990,9cyclictest0-21swapper/300:20:253
2214389990,9cyclictest0-21swapper/300:16:313
2214389990,1cyclictest357666-21ntpq22:50:173
2214389990,0cyclictest0-21swapper/322:45:453
2214389990,0cyclictest0-21swapper/320:39:323
2214349997,1cyclictest1024-21snmpd23:05:192
2214349997,1cyclictest1024-21snmpd21:41:372
2214349993,6cyclictest0-21swapper/220:43:022
2214349990,9cyclictest0-21swapper/220:16:552
2214349990,9cyclictest0-21swapper/219:41:482
2214349990,8cyclictest0-21swapper/219:56:092
2214349990,1cyclictest0-21swapper/223:45:382
2214329998,1cyclictest1957-21llvmpipe-321:03:591
2214329997,2cyclictest1024-21snmpd20:20:281
2214329997,1cyclictest1024-21snmpd22:22:151
2214329997,1cyclictest1024-21snmpd21:38:451
2214329997,1cyclictest1024-21snmpd00:32:421
2214329996,2cyclictest344715-21cat22:35:141
2214329990,9cyclictest1954-21llvmpipe-019:36:581
2214329990,8cyclictest0-21swapper/123:00:131
2214329990,1cyclictest0-21swapper/123:55:471
2214289998,1cyclictest1024-21snmpd23:58:500
2214289998,1cyclictest1024-21snmpd22:38:000
2214289998,1cyclictest1024-21snmpd20:20:430
2214289997,1cyclictest1024-21snmpd00:09:240
2214289990,9cyclictest0-21swapper/022:10:560
2214289990,9cyclictest0-21swapper/019:30:560
2214289990,7cyclictest0-21swapper/021:35:180
2214289990,4cyclictest269058-21ntpq21:00:180
2214389987,1cyclictest1024-21snmpd22:22:113
2214389987,1cyclictest1024-21snmpd21:53:443
2214389987,1cyclictest1024-21snmpd19:27:443
2214389987,1cyclictest1024-21snmpd00:06:473
2214389981,1cyclictest0-21swapper/323:55:153
2214389980,0cyclictest0-21swapper/322:55:223
2214349987,1cyclictest1024-21snmpd23:02:012
2214349986,1cyclictest1024-21snmpd22:05:132
2214349980,8cyclictest1957-21llvmpipe-323:41:582
2214329988,0cyclictest1024-21snmpd22:45:451
2214329986,1cyclictest1024-21snmpd20:05:211
2214289988,0cyclictest0-21swapper/023:05:140
2214289987,1cyclictest1024-21snmpd22:51:520
2214289980,0cyclictest0-21swapper/021:16:390
11069980,1ntpd33-21ksoftirqd/222:35:172
2214389970,7cyclictest425157-21ntpq00:10:163
2214389970,7cyclictest0-21swapper/319:35:323
2214389970,6cyclictest0-21swapper/319:40:123
2214389970,1cyclictest314838-21diskstats22:00:183
2214389970,0cyclictest0-21swapper/319:50:173
2214289976,1cyclictest1024-21snmpd21:08:450
11069970,0ntpd0-21swapper/020:40:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional