You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-09 - 01:30

x86 Intel Core i9-9900K @3600 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7.osadl.org (updated Tue Aug 09, 2022 00:45:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8449092190174,8sleep110-21swapper/1119:07:033
8451832182161,11sleep80-21swapper/819:09:5714
8318922181163,10sleep20-21swapper/219:05:178
8448212176157,10sleep30-21swapper/319:06:079
8451212173110,53sleep140-21swapper/1419:09:146
8450322168150,10sleep10-21swapper/119:08:131
8447992165148,9sleep50-21swapper/519:05:5211
8447632162151,5sleep120-21swapper/1219:05:434
8450182158138,10sleep90-21swapper/919:08:0515
8451422150130,10sleep130-21swapper/1319:09:295
8448742125106,10sleep40-21swapper/419:06:4010
845056211444,59sleep150-21swapper/1519:08:277
83012528582,1sleep100-21swapper/1019:05:092
83134828178,1sleep00-21swapper/019:05:150
845692997820,29cyclictest0-21swapper/221:05:378
845721996911,28cyclictest0-21swapper/1023:40:462
84504126853,6sleep60-21swapper/619:08:1812
84495425641,8sleep70-21swapper/719:07:3113
845695995425,29cyclictest0-21swapper/300:32:259
845724994921,28cyclictest0-21swapper/1100:26:223
845692994819,28cyclictest0-21swapper/223:41:228
845732994222,20cyclictest0-21swapper/1319:33:265
845695994113,28cyclictest0-21swapper/322:51:129
136699410,0ntpd0-21swapper/1023:55:432
845692994018,22cyclictest0-21swapper/200:05:218
136699340,1ntpd20250irq/126-ahci[0019:55:4311
845735993312,21cyclictest0-21swapper/1419:33:266
136699330,0ntpd0-21swapper/521:55:4311
136699320,0ntpd0-21swapper/520:55:4311
845703993130,1cyclictest57150irq/134-i91522:10:2511
845703993130,1cyclictest57150irq/134-i91522:10:2511
845692993029,1cyclictest291irq_work/223:51:368
84572499294,14cyclictest1072905-21Isolated00:55:013
845721992826,1cyclictest1191-21systemd-resolve20:35:262
84570099273,14cyclictest1621585-21firefox21:19:1210
84572499260,15cyclictest0-21swapper/1122:31:083
84569599260,26cyclictest0-21swapper/321:50:379
84572499250,25cyclictest1598478-21ssh22:50:183
84572499250,15cyclictest1621585-21firefox19:19:573
84572499250,15cyclictest0-21swapper/1123:58:453
84572499250,15cyclictest0-21swapper/1123:45:313
84572499250,15cyclictest0-21swapper/1123:45:303
84572199250,15cyclictest1621585-21firefox23:31:292
84572199250,15cyclictest0-21swapper/1000:22:092
84570399250,15cyclictest1621674-21TaskCon~ller11
84570099250,24cyclictest1102995-21rpc-worker20:27:2410
845692992514,10cyclictest1622107-21Socket00:55:018
845692992514,10cyclictest1622107-21Socket00:55:018
84569299250,15cyclictest1621936-21WebExtensions19:26:188
84569299250,15cyclictest1621629-21Socket00:55:018
84569299250,15cyclictest1621585-21firefox20:24:468
84569299250,15cyclictest12897-21Isolated00:55:018
845687992525,0cyclictest0-21swapper/121:20:251
84572499240,14cyclictest0-21swapper/1122:48:153
84572499240,14cyclictest0-21swapper/1121:45:573
84572499240,14cyclictest0-21swapper/1119:40:193
845721992424,0cyclictest57150irq/134-i91519:44:542
84572199240,14cyclictest0-21swapper/1023:36:312
84570399240,1cyclictest1503086-21sh22:21:5711
84570399240,1cyclictest1503086-21sh22:21:5611
84570099244,9cyclictest0-21swapper/419:36:2010
84569299240,14cyclictest0-21swapper/222:46:158
84569299240,14cyclictest0-21swapper/222:29:528
84569299240,14cyclictest0-21swapper/221:59:138
84569299240,14cyclictest0-21swapper/221:20:438
84569299240,14cyclictest0-21swapper/220:30:228
84569299240,14cyclictest0-21swapper/220:07:528
84569299240,14cyclictest0-21swapper/219:21:548
84572999230,13cyclictest0-21swapper/1220:39:474
84572999230,13cyclictest0-21swapper/1220:31:224
845724992322,1cyclictest57150irq/134-i91521:50:373
84572499231,12cyclictest1520934-21systemd-udevd22:26:053
84572499230,13cyclictest0-21swapper/1121:18:223
84572499230,13cyclictest0-21swapper/1120:01:463
84572499230,13cyclictest0-21swapper/1100:13:053
845721992322,0cyclictest57150irq/134-i91520:07:222
84572199230,13cyclictest0-21swapper/1023:17:532
84572199230,13cyclictest0-21swapper/1022:49:552
845703992311,10cyclictest149850irq/131-enp2s0-00:18:1011
845692992322,1cyclictest0-21swapper/222:05:598
845692992322,1cyclictest0-21swapper/222:05:598
845692992322,0cyclictest1191-21systemd-resolve22:56:178
84569299230,13cyclictest0-21swapper/222:32:578
84569299230,13cyclictest0-21swapper/221:04:048
84569299230,13cyclictest0-21swapper/219:39:178
84573299220,12cyclictest3496-21Xorg22:02:595
84573299220,12cyclictest3496-21Xorg22:02:595
84572999228,12cyclictest396420pipewire-pulse00:39:404
84572999220,12cyclictest0-21swapper/1223:21:594
84572999220,12cyclictest0-21swapper/1220:44:394
84572999220,12cyclictest0-21swapper/1220:28:184
845724992222,0cyclictest0-21swapper/1100:37:193
84572499220,12cyclictest0-21swapper/1123:20:583
84572499220,12cyclictest0-21swapper/1121:31:373
84572499220,12cyclictest0-21swapper/1119:21:183
84572199220,12cyclictest0-21swapper/1000:31:292
84572199220,12cyclictest0-21swapper/1000:01:412
845703992221,1cyclictest2784509-21ThreadPoolServi23:55:2311
84570099220,12cyclictest0-21swapper/400:05:1210
845692992221,1cyclictest57150irq/134-i91523:36:258
845692992211,10cyclictest1662292-21Isolated00:55:018
845692992211,10cyclictest1621864-21WRScene~ilder#121:10:118
84569299220,12cyclictest0-21swapper/222:43:108
84569299220,12cyclictest0-21swapper/222:14:338
84569299220,12cyclictest0-21swapper/222:14:338
84569299220,12cyclictest0-21swapper/221:34:428
84569299220,12cyclictest0-21swapper/220:57:578
84569299220,12cyclictest0-21swapper/220:49:458
84569299220,12cyclictest0-21swapper/200:04:568
84573999210,20cyclictest0-21swapper/1519:19:587
84573999210,11cyclictest0-21swapper/1520:40:327
84573299216,9cyclictest1081rcuc/1323:04:545
845729992119,1cyclictest1191-21systemd-resolve22:46:144
845729992111,10cyclictest0-21swapper/1222:11:294
845729992111,10cyclictest0-21swapper/1222:11:284
845729992111,0cyclictest0-21swapper/1221:26:314
845724992121,0cyclictest0-21swapper/1100:20:593
845724992121,0cyclictest0-21swapper/1100:02:583
845724992111,10cyclictest0-21swapper/1122:40:073
845724992111,10cyclictest0-21swapper/1122:24:543
845724992111,10cyclictest0-21swapper/1122:24:543
845724992111,10cyclictest0-21swapper/1122:06:463
845724992111,10cyclictest0-21swapper/1122:06:463
845724992111,10cyclictest0-21swapper/1121:55:573
845724992111,10cyclictest0-21swapper/1120:16:273
845724992111,10cyclictest0-21swapper/1119:13:433
845724992111,0cyclictest0-21swapper/1100:31:523
84572499210,21cyclictest0-21swapper/1100:09:063
84572499210,11cyclictest0-21swapper/1120:06:243
845721992111,10cyclictest0-21swapper/1021:04:482
845721992111,10cyclictest0-21swapper/1020:59:582
845721992111,10cyclictest0-21swapper/1019:15:002
845721992111,0cyclictest0-21swapper/1021:51:432
845721992111,0cyclictest0-21swapper/1021:38:462
845721992111,0cyclictest0-21swapper/1000:12:102
84572199210,11cyclictest0-21swapper/1021:25:442
845714992121,0cyclictest0-21swapper/823:46:5614
845714992121,0cyclictest0-21swapper/823:46:5514
845714992121,0cyclictest0-21swapper/823:28:5214
845714992121,0cyclictest0-21swapper/823:00:3114
845714992121,0cyclictest0-21swapper/800:05:1414
84571499210,0cyclictest0-21swapper/800:39:2814
84570699210,0cyclictest0-21swapper/600:16:5112
845695992119,1cyclictest1191-21systemd-resolve22:11:019
845695992119,1cyclictest1191-21systemd-resolve22:11:019
845692992111,10cyclictest1622386-21seamonkey20:10:188
845692992111,10cyclictest1621630-21IPDL00:55:018
845692992111,10cyclictest0-21swapper/223:46:358
845692992111,10cyclictest0-21swapper/223:46:358
845692992111,10cyclictest0-21swapper/223:29:078
845692992111,10cyclictest0-21swapper/223:15:528
845692992111,10cyclictest0-21swapper/223:11:248
845692992111,10cyclictest0-21swapper/222:51:228
845692992111,10cyclictest0-21swapper/222:20:408
845692992111,10cyclictest0-21swapper/222:20:408
845692992111,10cyclictest0-21swapper/221:40:498
845692992111,10cyclictest0-21swapper/221:35:428
845692992111,10cyclictest0-21swapper/221:25:448
845692992111,10cyclictest0-21swapper/221:17:218
845692992111,10cyclictest0-21swapper/220:27:178
845692992111,10cyclictest0-21swapper/219:55:108
845692992111,10cyclictest0-21swapper/219:48:278
845692992111,10cyclictest0-21swapper/200:38:378
845692992111,10cyclictest0-21swapper/200:20:158
845692992111,0cyclictest0-21swapper/200:16:468
845692992110,9cyclictest396420pipewire-pulse20:35:288
84569299210,11cyclictest0-21swapper/222:15:348
84569299210,11cyclictest0-21swapper/219:30:058
84569299210,11cyclictest0-21swapper/200:31:278
150297222120,0sleep150-21swapper/1522:21:437
150297222120,0sleep150-21swapper/1522:21:437
146728322120,0sleep150-21swapper/1522:13:117
146728322120,0sleep150-21swapper/1522:13:117
137645522120,0sleep140-21swapper/1421:48:366
123158322120,0sleep140-21swapper/1421:09:226
123119722120,0sleep150-21swapper/1521:05:397
118376022120,0sleep140-21swapper/1420:53:536
84573599200,10cyclictest0-21swapper/1421:16:186
84573299204,10cyclictest1621585-21firefox22:47:305
845732992010,0cyclictest0-21swapper/1300:33:585
84572999204,8cyclictest0-21swapper/1222:51:544
845729992010,10cyclictest0-21swapper/1223:28:064
845729992010,10cyclictest0-21swapper/1222:38:584
845729992010,10cyclictest0-21swapper/1222:03:184
845729992010,10cyclictest0-21swapper/1222:03:184
845729992010,10cyclictest0-21swapper/1221:14:164
845729992010,10cyclictest0-21swapper/1200:11:434
845729992010,10cyclictest0-21swapper/1200:05:134
845724992010,10cyclictest1621629-21Socket00:55:013
845724992010,10cyclictest0-21swapper/1123:44:593
845724992010,10cyclictest0-21swapper/1123:12:463
845724992010,10cyclictest0-21swapper/1122:36:513
845724992010,10cyclictest0-21swapper/1122:18:393
845724992010,10cyclictest0-21swapper/1121:00:593
845721992011,0cyclictest0-21swapper/1019:39:152
845721992010,10cyclictest0-21swapper/1023:50:342
845721992010,10cyclictest0-21swapper/1023:28:052
845721992010,10cyclictest0-21swapper/1023:24:002
845721992010,10cyclictest0-21swapper/1022:01:152
845721992010,10cyclictest0-21swapper/1022:01:152
845721992010,10cyclictest0-21swapper/1021:59:142
845721992010,10cyclictest0-21swapper/1021:32:382
845721992010,10cyclictest0-21swapper/1021:21:382
845721992010,10cyclictest0-21swapper/1021:16:372
845721992010,10cyclictest0-21swapper/1019:55:122
845721992010,10cyclictest0-21swapper/1019:34:432
84572199200,20cyclictest0-21swapper/1022:55:242
845719992019,1cyclictest1282696-21nodedev-init21:20:2415
845714992020,0cyclictest0-21swapper/822:53:5614
845706992015,4cyclictest1332-21snmpd23:59:4912
845703992019,1cyclictest0-21swapper/521:44:5111
845700992010,10cyclictest0-21swapper/421:02:2810
845700992010,0cyclictest0-21swapper/423:07:3910
845692992011,9cyclictest0-21swapper/223:55:428
845692992010,10cyclictest0-21swapper/223:20:578
845692992010,10cyclictest0-21swapper/223:01:568
845692992010,10cyclictest0-21swapper/222:35:168
845692992010,10cyclictest0-21swapper/221:51:028
845692992010,10cyclictest0-21swapper/220:15:208
845692992010,10cyclictest0-21swapper/220:04:498
845692992010,10cyclictest0-21swapper/219:11:408
845692992010,10cyclictest0-21swapper/200:25:018
197773222019,0sleep140-21swapper/1400:31:266
190340022019,0sleep140-21swapper/1400:10:376
186781922019,0sleep140-21swapper/1400:01:166
183291822019,0sleep140-21swapper/1423:54:056
181352922019,0sleep150-21swapper/1523:46:377
181352922019,0sleep150-21swapper/1523:46:377
177850022019,0sleep150-21swapper/1523:39:407
174186722019,0sleep150-21swapper/1523:29:157
159477722019,0sleep140-21swapper/1422:48:086
150242222019,0sleep140-21swapper/1422:20:386
150242222019,0sleep140-21swapper/1422:20:386
108847022019,0sleep150-21swapper/1520:21:047
89860521918,0sleep140-21swapper/1419:23:396
84573299199,10cyclictest0-21swapper/1319:29:065
84572999199,10cyclictest0-21swapper/1223:03:344
84572999199,10cyclictest0-21swapper/1222:16:364
84572999199,10cyclictest0-21swapper/1221:34:424
84572999199,0cyclictest0-21swapper/1223:06:394
84572999198,10cyclictest1621936-21WebExtensions21:15:184
84572999198,10cyclictest0-21swapper/1220:11:584
845729991918,1cyclictest1332-21snmpd20:56:504
84572499199,10cyclictest0-21swapper/1123:32:013
84572499199,10cyclictest0-21swapper/1122:59:563
84572499199,10cyclictest0-21swapper/1121:20:233
84572499199,10cyclictest0-21swapper/1120:54:533
84572499199,10cyclictest0-21swapper/1119:56:373
845724991919,0cyclictest0-21swapper/1123:54:473
845724991918,1cyclictest1627490-21GLXVsyncThread23:01:233
84572199199,10cyclictest0-21swapper/1023:50:002
84572199199,10cyclictest0-21swapper/1023:49:592
84572199199,10cyclictest0-21swapper/1022:36:002
84572199199,10cyclictest0-21swapper/1022:24:552
84572199199,10cyclictest0-21swapper/1022:24:542
84572199199,10cyclictest0-21swapper/1021:10:102
84572199199,10cyclictest0-21swapper/1021:06:052
84572199199,10cyclictest0-21swapper/1000:05:552
845721991919,0cyclictest0-21swapper/1022:16:352
845714991919,0cyclictest0-21swapper/823:58:0514
845714991919,0cyclictest0-21swapper/823:17:0814
845714991919,0cyclictest0-21swapper/822:57:1314
845714991919,0cyclictest0-21swapper/822:48:2914
845714991919,0cyclictest0-21swapper/800:28:5214
845714991919,0cyclictest0-21swapper/800:20:1614
845714991919,0cyclictest0-21swapper/800:17:2614
845714991919,0cyclictest0-21swapper/800:10:2414
845706991914,5cyclictest1332-21snmpd21:34:0612
84570399199,10cyclictest0-21swapper/522:56:0011
845703991917,2cyclictest0-21swapper/519:42:5111
84570399190,19cyclictest0-21swapper/520:40:2411
84570399190,0cyclictest0-21swapper/519:53:0911
84570099199,10cyclictest0-21swapper/420:44:4710
84570099199,10cyclictest0-21swapper/420:23:1010
84570099199,0cyclictest0-21swapper/419:14:4310
845700991918,1cyclictest1332-21snmpd00:32:5310
84569599199,10cyclictest0-21swapper/320:31:529
84569299199,10cyclictest0-21swapper/219:40:068
84569299199,10cyclictest0-21swapper/200:12:118
84568799190,19cyclictest0-21swapper/100:20:221
84568799190,0cyclictest0-21swapper/121:56:111
84568399190,0cyclictest0-21swapper/019:24:420
396020190,8pipewire0-21swapper/322:40:079
136699190,1ntpd53-21ksoftirqd/519:14:0111
110433621919,0sleep140-21swapper/1420:26:556
84573999180,8cyclictest0-21swapper/1523:20:427
84573599180,8cyclictest0-21swapper/1422:33:166
84573599180,8cyclictest0-21swapper/1400:35:326
84573299188,10cyclictest0-21swapper/1322:38:025
845732991818,0cyclictest0-21swapper/1300:16:185
845732991816,1cyclictest0-21swapper/1320:46:535
84572999188,10cyclictest0-21swapper/1223:50:354
84572999188,10cyclictest0-21swapper/1219:49:284
84572999188,10cyclictest0-21swapper/1219:15:454
84572999188,10cyclictest0-21swapper/1200:16:374
84572499188,10cyclictest0-21swapper/1122:12:323
84572499188,10cyclictest0-21swapper/1122:12:323
84572499180,0cyclictest1414310-21ssh22:00:053
84572499180,0cyclictest1414310-21ssh22:00:053
84572199188,10cyclictest21850irq/127-xhci_hc00:16:472
84572199188,10cyclictest0-21swapper/1022:25:462
84572199188,10cyclictest0-21swapper/1020:21:272
84572199188,0cyclictest0-21swapper/1000:29:252
84572199182,8cyclictest4187-40baloo_file22:50:392
845721991818,0cyclictest0-21swapper/1019:21:372
84572199180,0cyclictest0-21swapper/1020:51:472
845714991818,0cyclictest0-21swapper/823:30:5214
845714991818,0cyclictest0-21swapper/823:08:1514
845706991818,0cyclictest1978592-21kworker/6:000:35:4212
845706991814,0cyclictest1332-21snmpd23:35:5712
845706991812,1cyclictest1332-21snmpd23:29:1812
84570699180,18cyclictest0-21swapper/620:07:5112
84570699180,0cyclictest0-21swapper/619:33:2012
845703991818,0cyclictest0-21swapper/523:50:0811
845703991817,1cyclictest0-21swapper/523:43:5911
845703991817,1cyclictest0-21swapper/522:47:3411
845703991817,1cyclictest0-21swapper/500:24:4711
845703991810,5cyclictest0-21swapper/519:35:1711
84570399180,18cyclictest1721164-21ssh23:20:3011
84570399180,0cyclictest0-21swapper/522:29:2211
84570099188,10cyclictest0-21swapper/420:04:0010
84570099188,10cyclictest0-21swapper/400:28:5810
84570099184,7cyclictest0-21swapper/423:38:4610
845695991818,0cyclictest0-21swapper/321:08:299
845695991818,0cyclictest0-21swapper/300:00:199
845695991816,2cyclictest0-21swapper/323:31:029
84569599180,8cyclictest39-21ksoftirqd/322:59:059
84569599180,18cyclictest0-21swapper/323:50:009
84569599180,18cyclictest0-21swapper/323:50:009
84569299188,10cyclictest0-21swapper/223:06:238
845687991818,0cyclictest1332-21snmpd20:51:141
845687991818,0cyclictest0-21swapper/122:55:271
845687991818,0cyclictest0-21swapper/122:21:141
845687991818,0cyclictest0-21swapper/122:21:141
845687991818,0cyclictest0-21swapper/122:10:041
845687991818,0cyclictest0-21swapper/122:10:041
845687991818,0cyclictest0-21swapper/121:25:061
845687991818,0cyclictest0-21swapper/100:37:501
845687991818,0cyclictest0-21swapper/100:04:111
84568799180,18cyclictest0-21swapper/123:46:441
84568799180,18cyclictest0-21swapper/123:46:431
84568799180,18cyclictest0-21swapper/123:30:321
84568799180,18cyclictest0-21swapper/123:27:331
84568799180,18cyclictest0-21swapper/121:49:351
84568799180,0cyclictest0-21swapper/122:41:001
84568799180,0cyclictest0-21swapper/120:20:141
845683991818,0cyclictest3496-21Xorg22:01:030
845683991818,0cyclictest3496-21Xorg22:01:030
845683991818,0cyclictest0-21swapper/020:28:250
845683991818,0cyclictest0-21swapper/020:19:230
845683991818,0cyclictest0-21swapper/019:25:330
84568399180,18cyclictest0-21swapper/023:20:140
84568399180,18cyclictest0-21swapper/022:40:430
84568399180,18cyclictest0-21swapper/022:24:320
84568399180,18cyclictest0-21swapper/022:24:320
84568399180,18cyclictest0-21swapper/022:09:400
84568399180,18cyclictest0-21swapper/022:09:390
84568399180,18cyclictest0-21swapper/000:36:000
84568399180,0cyclictest0-21swapper/021:58:120
84568399180,0cyclictest0-21swapper/000:35:000
845739991717,0cyclictest0-21swapper/1523:50:537
845739991717,0cyclictest0-21swapper/1523:13:137
845739991717,0cyclictest0-21swapper/1523:06:307
845739991717,0cyclictest0-21swapper/1521:45:277
845739991717,0cyclictest0-21swapper/1519:27:167
84573999170,7cyclictest0-21swapper/1522:01:187
84573999170,7cyclictest0-21swapper/1522:01:177
84573999170,7cyclictest0-21swapper/1520:16:277
84573999170,0cyclictest0-21swapper/1519:37:217
845735991717,0cyclictest0-21swapper/1420:43:056
845735991717,0cyclictest0-21swapper/1419:49:006
845735991717,0cyclictest0-21swapper/1419:10:486
84573599170,7cyclictest0-21swapper/1423:27:036
84573599170,7cyclictest0-21swapper/1400:29:266
84573599170,0cyclictest0-21swapper/1423:13:006
845732991717,0cyclictest0-21swapper/1300:01:505
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional