You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-17 - 19:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackbslot1.osadl.org (updated Mon Feb 17, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39922942238210,18sleep20-21swapper/207:09:442
39920122214184,21sleep00-21swapper/007:06:130
39921812203175,18sleep30-21swapper/307:08:163
39921382190166,14sleep10-21swapper/107:07:461
399254599931,88cyclictest4024093-21ThreadPoolForeg07:45:013
399254599870,2cyclictest3451166-21ThreadPoolForeg10:45:023
3992545996448,11cyclictest4180-21latency_hist11:15:013
3992539996259,2cyclictest4162729-21kworker/u8:4+flush-179:010:50:151
40289142610,1chrt4028913-21apache_processe07:50:063
3992541996154,5cyclictest4046108-21/usr/share/muni08:10:092
3992539995853,4cyclictest4054646-21latency_hist08:20:011
3992541995650,5cyclictest3451167-21ThreadPoolForeg09:05:082
3992535995651,4cyclictest3451132-21Chrome_ChildIOT10:30:230
3992539995349,3cyclictest4177769-21kworker/u8:1+events_unbound11:20:011
3992541995235,5cyclictest3451073-20chrome08:25:162
3992539995248,3cyclictest4006050-21kworker/u8:0+flush-179:007:30:211
3992539995147,3cyclictest4085531-21kworker/u8:3+flush-179:009:05:381
3992539995147,3cyclictest4060055-21kworker/u8:4+flush-179:008:55:231
3992545995044,4cyclictest4019703-21/usr/share/muni07:40:093
3992541994945,3cyclictest4177769-21kworker/u8:1+flush-179:011:00:332
3992539994844,3cyclictest4127439-21kworker/u8:0+flush-179:009:50:101
3992539994842,4cyclictest4146521-21/usr/share/muni10:10:021
3992535994832,15cyclictest4002242-21/usr/share/muni07:20:160
3992545994741,5cyclictest3451167-21ThreadPoolForeg10:50:283
3992541994742,3cyclictest4123045-21kworker/u8:2+flush-179:009:45:012
3992541994740,5cyclictest4099146-21/usr/share/muni09:10:092
3992539994741,4cyclictest4177769-21kworker/u8:1+flush-179:011:34:251
3992535994742,4cyclictest4162279-21latency_hist10:30:010
3992541994642,3cyclictest4006050-21kworker/u8:0+flush-179:007:45:242
3992541994642,3cyclictest3987715-21kworker/u8:2+events_unbound07:15:082
3992539994642,3cyclictest4041318-21kworker/u8:1+flush-179:008:30:111
3992539994632,13cyclictest3979073-21kworker/u8:1+flush-179:007:17:021
3992539994540,4cyclictest4177769-21kworker/u8:1+flush-179:011:00:161
3992539994539,4cyclictest4063393-21latency_hist08:30:011
3992535994540,3cyclictest3606026-21chrome07:45:010
3992545994441,2cyclictest4098630-21kworker/u8:4+flush-179:009:20:313
3992539994440,3cyclictest4177769-21kworker/u8:1+flush-179:011:55:321
3992539994439,4cyclictest4176544-21ThreadPoolForeg10:45:171
3992539994439,3cyclictest4006050-21kworker/u8:0+flush-179:008:05:101
3992539994438,4cyclictest12759-21kworker/u8:0+flush-179:011:45:441
3992545994338,4cyclictest29087-21latency_hist11:45:013
3992545994337,5cyclictest3987353-21kworker/3:2+pm08:14:373
3992539994339,2cyclictest4177769-21kworker/u8:1+flush-179:011:20:191
55682420,1sleep04427-21/usr/share/muni11:15:150
3992545994238,3cyclictest4103266-21latency_hist09:15:003
3992545994237,4cyclictest3606029-21ThreadPoolForeg08:05:333
3992545994234,7cyclictest3200131-1kworker/3:2H+kblockd11:37:093
3992545994233,8cyclictest3200131-1kworker/3:2H+kblockd11:21:133
3992545994228,13cyclictest3200131-1kworker/3:2H+kblockd08:38:483
3992541994237,3cyclictest4177769-21kworker/u8:1+events_unbound11:40:012
3992541994217,24cyclictest4177769-21kworker/u8:1+events_unbound12:01:082
3992539994238,3cyclictest4085531-21kworker/u8:3+events_unbound09:05:021
399253999421,39cyclictest3606026-21chrome12:28:471
3992535994237,3cyclictest4182131-1kworker/0:2H+kblockd11:30:180
3992535994236,5cyclictest2377-21apt-get11:10:190
399254599410,40cyclictest3451163-21chrome09:38:493
3992541994137,2cyclictest4134452-21kworker/2:0+pm10:20:372
3992541994137,2cyclictest4134452-21kworker/2:0+pm09:57:432
3992541994137,2cyclictest4072193-21kworker/2:0+pm08:51:002
3992541994137,2cyclictest4072193-21kworker/2:0+pm08:49:232
3992541994137,2cyclictest40341-21kworker/2:2+pm12:13:042
3992541994136,4cyclictest4041318-21kworker/u8:1+events_unbound09:25:112
3992541994136,4cyclictest3939403-21kworker/2:1+pm07:55:062
3992541994136,3cyclictest4134452-21kworker/2:0+pm10:15:362
3992541994136,3cyclictest3939403-21kworker/2:1+pm07:22:122
3992541994136,3cyclictest3939403-21kworker/2:1+pm07:12:332
3992541994135,4cyclictest4060055-21kworker/u8:4+flush-179:008:40:152
3992541994135,4cyclictest4060055-21kworker/u8:4+flush-179:008:40:152
3992541994133,6cyclictest4123614-21/usr/share/muni09:40:042
3992539994139,1cyclictest8159-1kworker/1:1H+kblockd12:22:431
3992539994138,2cyclictest3661109-1kworker/1:2H+kblockd08:41:181
3992539994138,2cyclictest3661109-1kworker/1:2H+kblockd08:41:181
3992539994138,2cyclictest36286-21kworker/u8:0+flush-179:012:15:331
3992539994138,2cyclictest19784-21kworker/u8:3+flush-179:011:35:141
3992539994137,3cyclictest4182512-21munin-update10:55:341
3992539994136,3cyclictest4159755-21kworker/u8:2+flush-179:010:44:471
3992539994133,6cyclictest3605991-21ThreadPoolForeg09:30:181
3992535994138,2cyclictest3605935-213fbbdc8314cb6c110:45:020
3992535994135,5cyclictest3451168-20Chrome_ChildIOT08:11:180
3992545994036,3cyclictest34443-21apt-get11:50:183
3992545994036,3cyclictest34443-21apt-get11:50:183
3992545994036,3cyclictest3335049-21systemd-journal11:59:593
3992545994035,4cyclictest4143833-21/usr/share/muni10:05:173
3992545994035,4cyclictest4139492-21/usr/share/muni10:00:133
3992545994020,10cyclictest3606031-13Chrome_ChildIOT09:32:273
3992541994038,1cyclictest62803-21kworker/2:0+pm12:37:232
3992541994037,2cyclictest4170236-21kworker/2:1+pm11:43:152
3992541994037,2cyclictest4170236-21kworker/2:1+pm11:32:262
3992541994037,2cyclictest4134452-21kworker/2:0+pm10:10:092
3992541994037,2cyclictest4134452-21kworker/2:0+pm10:05:262
3992541994037,2cyclictest4072193-21kworker/2:0+pm09:22:072
3992541994037,2cyclictest3939403-21kworker/2:1+pm08:24:592
3992541994037,2cyclictest3939403-21kworker/2:1+pm07:42:142
3992541994037,2cyclictest3939403-21kworker/2:1+pm07:31:362
3992541994036,3cyclictest4170236-21kworker/2:1+pm11:06:442
3992541994036,2cyclictest4163768-21kworker/2:2+pm10:39:052
3992541994036,2cyclictest4072193-21kworker/2:0+pm09:00:162
3992541994035,4cyclictest3952824-1kworker/2:1H+kblockd09:15:082
3992541994035,3cyclictest4134452-21kworker/2:0+pm10:00:262
399254199401,14cyclictest3605905-21python308:06:082
3992539994036,3cyclictest4041318-21kworker/u8:1+flush-179:009:10:341
3992539994036,3cyclictest3952516-21kworker/u8:3+events_unbound07:45:011
3992539994035,4cyclictest3952516-21kworker/u8:3+flush-179:007:55:211
3992539994035,3cyclictest4085531-21kworker/u8:3+flush-179:009:15:281
3992539994034,4cyclictest4135099-21/usr/share/muni09:55:151
3992535994036,3cyclictest4123045-21kworker/u8:2+flush-179:009:40:160
3992535994035,3cyclictest4118985-21munin-update09:35:330
3992535994034,4cyclictest3624683-21apache212:20:160
3992545993933,5cyclictest3200131-1kworker/3:2H+kblockd10:36:143
3992545993926,7cyclictest1276-21snmpd10:22:303
3992541993937,1cyclictest4170236-21kworker/2:1+pm11:47:442
3992541993937,1cyclictest40341-21kworker/2:2+pm12:09:132
3992541993937,1cyclictest3939403-21kworker/2:1+pm08:04:452
3992541993936,2cyclictest62803-21kworker/2:0+pm12:34:482
3992541993936,2cyclictest4170236-21kworker/2:1+pm11:20:082
3992541993936,2cyclictest4170236-21kworker/2:1+pm11:15:332
3992541993936,2cyclictest4170236-21kworker/2:1+pm11:10:042
3992541993936,2cyclictest4170236-21kworker/2:1+pm10:55:512
3992541993936,2cyclictest40341-21kworker/2:2+pm12:28:192
3992541993936,2cyclictest40341-21kworker/2:2+pm12:15:192
3992541993936,2cyclictest3939403-21kworker/2:1+pm08:35:042
3992541993935,3cyclictest4123226-21kworker/2:1+pm09:54:162
3992541993935,3cyclictest4041318-21kworker/u8:1+events_unbound09:31:042
3992541993934,3cyclictest4170236-21kworker/2:1+pm11:56:132
3992541993933,4cyclictest3952824-1kworker/2:1H+kblockd07:50:042
3992541993911,27cyclictest4015293-21/usr/share/muni07:35:042
3992539993936,2cyclictest4118753-21kworker/1:2+pm11:29:581
3992539993936,2cyclictest3969728-21kworker/u8:0+flush-179:007:10:221
3992539993935,3cyclictest4162729-21kworker/u8:4+flush-179:010:34:251
3992539993935,2cyclictest4145854-21kworker/u8:0+flush-179:010:20:171
399253999391,37cyclictest4192138-21apache_volume11:05:101
3992535993936,2cyclictest4175326-21kworker/0:0+pm11:29:480
3992535993936,2cyclictest4036977-21kworker/0:3+pm08:44:220
3992535993936,2cyclictest4036977-21kworker/0:3+pm08:44:220
3992535993935,2cyclictest4182131-1kworker/0:2H+kblockd12:34:160
3992535993934,4cyclictest4182512-21munin-update10:55:060
3992535993932,5cyclictest4155618-21/usr/share/muni10:20:130
3992535993932,5cyclictest36470-21/usr/share/muni11:55:060
3992535993911,1cyclictest0-21swapper/010:17:390
40242572380,1chrt4024243-21snmp_wanswitch.07:45:021
3992545993836,1cyclictest4080887-21kworker/3:1+pm08:48:563
3992545993835,2cyclictest60715-21kworker/u8:3+flush-179:012:30:163
3992545993829,8cyclictest1276-21snmpd09:40:163
3992545993822,15cyclictest4001490-21munin-limits07:15:373
399254599381,4cyclictest3605905-21python309:00:313
399254599380,2cyclictest0-21swapper/308:41:233
399254599380,2cyclictest0-21swapper/308:41:233
3992541993836,1cyclictest3939403-21kworker/2:1+pm07:25:312
3992541993835,2cyclictest4134452-21kworker/2:0+pm10:30:092
3992541993835,2cyclictest4072193-21kworker/2:0+pm09:37:582
3992541993834,2cyclictest3952824-1kworker/2:1H+kblockd08:19:162
3992541993833,4cyclictest60051-31munin-html12:20:342
3992541993833,3cyclictest4072193-21kworker/2:0+pm08:55:052
3992541993833,3cyclictest3939403-21kworker/2:1+pm08:30:052
3992541993832,4cyclictest3952824-1kworker/2:1H+kblockd10:45:032
399254199381,13cyclictest3451170-20Compositor10:50:432
3992539993834,3cyclictest4098630-21kworker/u8:4+flush-179:009:35:101
3992539993834,3cyclictest3661109-1kworker/1:2H+kblockd08:37:541
3992539993834,3cyclictest12759-21kworker/u8:0+flush-179:011:40:221
3992539993833,3cyclictest4123045-21kworker/u8:2+flush-179:010:00:261
3992539993833,3cyclictest4041318-21kworker/u8:1+flush-179:010:15:101
3992539993831,5cyclictest4080698-31munin-graph08:45:501
399253999380,36cyclictest3606026-21chrome08:21:101
3992535993835,2cyclictest4036977-21kworker/0:3+pm08:02:480
3992535993831,5cyclictest67810-21/usr/share/muni12:35:160
3992545993734,2cyclictest3987353-21kworker/3:2+pm07:12:073
3992545993734,2cyclictest3200131-1kworker/3:2H+kblockd12:15:153
3992545993734,2cyclictest3200131-1kworker/3:2H+kblockd12:06:053
3992545993734,2cyclictest3200131-1kworker/3:2H+kblockd10:55:243
3992545993734,2cyclictest3200131-1kworker/3:2H+kblockd08:20:593
3992545993734,2cyclictest3200131-1kworker/3:2H+kblockd07:23:363
3992545993733,3cyclictest3200131-1kworker/3:2H+kblockd08:53:343
3992545993733,2cyclictest3606031-13Chrome_ChildIOT12:01:443
3992545993731,4cyclictest4015287-21/usr/share/muni07:35:013
3992545993726,10cyclictest3605995-21Chrome_DevTools09:48:503
3992545993718,18cyclictest3606029-21ThreadPoolForeg09:50:083
399254599371,35cyclictest3451170-20Compositor11:30:233
3992541993735,1cyclictest4170236-21kworker/2:1+pm10:40:452
399254199371,3cyclictest3605905-21python310:25:432
3992541993711,24cyclictest3606026-21chrome11:51:102
3992541993711,24cyclictest3606026-21chrome11:51:102
3992539993734,2cyclictest3661109-1kworker/1:2H+kblockd08:10:311
3992539993733,3cyclictest8159-1kworker/1:1H+kblockd12:31:121
3992539993732,3cyclictest4085531-21kworker/u8:3+flush-179:009:40:011
3992539993731,5cyclictest3605991-21ThreadPoolForeg11:10:081
3992539993731,4cyclictest3335049-21systemd-journal08:55:011
3992535993734,2cyclictest4182131-1kworker/0:2H+kblockd12:29:130
3992535993734,2cyclictest4182131-1kworker/0:2H+kblockd12:15:160
3992535993734,2cyclictest3765950-1kworker/0:1H+kblockd10:38:270
3992535993734,2cyclictest3765950-1kworker/0:1H+kblockd09:57:400
3992535993734,2cyclictest3765950-1kworker/0:1H+kblockd09:27:170
3992535993734,2cyclictest3765950-1kworker/0:1H+kblockd08:18:230
3992535993733,3cyclictest4006050-21kworker/u8:0+flush-179:008:05:120
3992535993732,3cyclictest4106941-31munin-html09:15:340
3992535993732,3cyclictest3765950-1kworker/0:1H+kblockd07:39:250
3992545993634,1cyclictest3451163-21chrome07:32:283
3992545993634,1cyclictest3200131-1kworker/3:2H+kblockd08:55:013
3992545993633,2cyclictest3200131-1kworker/3:2H+kblockd11:45:163
3992545993633,2cyclictest3200131-1kworker/3:2H+kblockd09:56:543
3992545993633,2cyclictest3200131-1kworker/3:2H+kblockd07:27:283
3992545993632,3cyclictest3200131-1kworker/3:2H+kblockd07:55:313
3992545993630,5cyclictest3451167-21ThreadPoolForeg09:15:043
3992545993628,7cyclictest1276-21snmpd10:32:453
3992545993626,4cyclictest3200131-1kworker/3:2H+kblockd12:35:503
3992541993633,2cyclictest4170236-21kworker/2:1+pm11:29:432
3992539993634,1cyclictest8159-1kworker/1:1H+kblockd12:36:521
3992539993634,1cyclictest3661109-1kworker/1:2H+kblockd07:35:191
3992539993633,2cyclictest8159-1kworker/1:1H+kblockd12:07:531
3992539993633,2cyclictest8159-1kworker/1:1H+kblockd11:53:431
3992539993633,2cyclictest8159-1kworker/1:1H+kblockd11:53:431
3992539993633,2cyclictest3661109-1kworker/1:2H+kblockd09:45:051
3992539993633,2cyclictest3661109-1kworker/1:2H+kblockd07:53:581
3992539993632,2cyclictest3661109-1kworker/1:2H+kblockd07:20:081
3992539993630,5cyclictest4170500-31munin-html10:35:381
3992535993634,1cyclictest4182131-1kworker/0:2H+kblockd12:10:280
3992535993633,2cyclictest4182131-1kworker/0:2H+kblockd11:48:490
3992535993633,2cyclictest3765950-1kworker/0:1H+kblockd10:00:080
3992535993633,2cyclictest3765950-1kworker/0:1H+kblockd09:07:390
3992535993633,2cyclictest3765950-1kworker/0:1H+kblockd07:29:490
3992535993633,2cyclictest3451170-20Compositor10:40:140
3992535993632,3cyclictest4089759-31munin-html08:55:370
3992535993629,5cyclictest3451163-21chrome09:00:080
3992545993533,1cyclictest3200131-1kworker/3:2H+kblockd08:32:323
3992545993532,2cyclictest3200131-1kworker/3:2H+kblockd12:11:573
3992545993532,2cyclictest3200131-1kworker/3:2H+kblockd10:27:463
3992545993532,2cyclictest3200131-1kworker/3:2H+kblockd09:26:453
3992545993532,2cyclictest3200131-1kworker/3:2H+kblockd09:05:243
3992545993514,19cyclictest3606026-21chrome10:17:113
399254599351,33cyclictest0-21swapper/311:08:043
3992539993532,2cyclictest3661109-1kworker/1:2H+kblockd09:22:351
3992539993531,3cyclictest4123045-21kworker/u8:2+events_unbound10:06:161
3992539993530,3cyclictest8159-1kworker/1:1H+kblockd12:10:051
3992535993533,1cyclictest3765950-1kworker/0:1H+kblockd07:43:410
3992535993532,2cyclictest3765950-1kworker/0:1H+kblockd10:12:140
3992535993532,2cyclictest3765950-1kworker/0:1H+kblockd09:33:350
3992535993532,2cyclictest3765950-1kworker/0:1H+kblockd09:23:260
3992535993530,4cyclictest24090-21munin-limits11:35:380
3992545993432,1cyclictest3200131-1kworker/3:2H+kblockd08:00:073
3992545993431,2cyclictest3200131-1kworker/3:2H+kblockd11:02:343
3992545993429,4cyclictest56554-21/usr/share/muni12:20:163
3992545993429,4cyclictest1276-21snmpd12:25:033
3992545993419,13cyclictest3606031-13Chrome_ChildIOT08:26:583
399254599341,15cyclictest3451163-21chrome08:15:053
3992545993411,4cyclictest4171398-21snmp_areswitch.10:40:033
3992535993431,2cyclictest4182131-1kworker/0:2H+kblockd11:20:080
3992535993431,2cyclictest4041318-21kworker/u8:1+flush-179:008:51:460
3992535993431,2cyclictest4036977-21kworker/0:3+pm09:48:130
3992535993431,2cyclictest3765950-1kworker/0:1H+kblockd07:19:440
3992535993431,2cyclictest3605933-21ChromeDriver15:20:430
3992535993427,5cyclictest3606029-21ThreadPoolForeg08:35:380
3992545993320,2cyclictest4959-21apache_accesses11:15:103
399254599331,2cyclictest0-21swapper/310:10:233
3992539993330,3cyclictest4159755-21kworker/u8:2+flush-179:010:25:101
3992539993329,3cyclictest4098630-21kworker/u8:4+events_unbound09:29:131
3992539993329,3cyclictest36286-21kworker/u8:0+flush-179:012:00:281
3992535993330,2cyclictest4182131-1kworker/0:2H+kblockd11:42:230
3992535993330,2cyclictest4182131-1kworker/0:2H+kblockd11:04:240
3992535993330,2cyclictest3765950-1kworker/0:1H+kblockd07:32:010
3992535993330,2cyclictest1276-21snmpd07:56:010
3992535993327,4cyclictest4144031-21ntpq10:05:070
3992535993320,2cyclictest3606031-13Chrome_ChildIOT10:53:160
399253599330,31cyclictest4032531-21sshd07:52:360
399254599322,5cyclictest3451163-21chrome11:25:033
3992539993230,1cyclictest1276-21snmpd07:25:121
3992539993228,2cyclictest3661109-1kworker/1:2H+kblockd08:00:161
3992535993230,1cyclictest1276-21snmpd08:31:380
3992535993229,2cyclictest4177769-21kworker/u8:1+flush-179:012:01:480
3992535993229,2cyclictest3765950-1kworker/0:1H+kblockd09:12:520
3992535993129,1cyclictest1276-21snmpd08:28:110
3992535993128,2cyclictest4182131-1kworker/0:2H+kblockd12:08:090
3992535993128,2cyclictest3606031-13Chrome_ChildIOT09:50:140
3992535993028,1cyclictest2854065-21isc-net-000007:14:370
3992535993027,2cyclictest3765950-1kworker/0:1H+kblockd08:45:060
3992535993027,2cyclictest3606019-13Chrome_ChildIOT11:09:150
3992535993024,4cyclictest3606029-21ThreadPoolForeg11:52:380
3992535993024,4cyclictest3606029-21ThreadPoolForeg11:52:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional