You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 05:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Fri Dec 12, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8303527161,7sleep50-21swapper/503:20:045
83501996663,2cyclictest581198-21kworker/u16:3+flush-8:007:42:136
83497995754,2cyclictest278535-21kworker/u16:0+flush-8:005:27:134
83500995048,2cyclictest369563-21kworker/u16:2+flush-8:006:47:425
8300724838,7sleep40-21swapper/403:19:394
83506994742,4cyclictest399752-21latency_hist05:57:137
83506994540,4cyclictest198183-21latency_hist04:17:147
83497994543,2cyclictest470741-21kworker/u16:3+events_unbound07:02:134
83506994439,4cyclictest490555-21latency_hist06:42:137
83500994240,2cyclictest521055-21kworker/u16:4+events_unbound07:20:295
83500994240,2cyclictest278535-21kworker/u16:0+flush-8:006:15:245
83497994239,2cyclictest26655-21kworker/u16:2+flush-8:003:32:144
8296724232,7sleep60-21swapper/603:19:096
83506994136,4cyclictest581394-21latency_hist07:27:147
83500994139,2cyclictest258395-21kworker/u16:2+events_unbound05:02:415
83497994137,3cyclictest712878-21kworker/u16:2+flush-8:008:37:284
735762403,31sleep70-21swapper/703:17:177
83501993835,2cyclictest521055-21kworker/u16:4+flush-8:007:42:336
83501993835,2cyclictest521055-21kworker/u16:4+flush-8:007:42:336
83500993836,2cyclictest661141-21kworker/u16:5+events_unbound08:27:435
83500993836,2cyclictest278535-21kworker/u16:0+flush-8:005:07:395
83501993734,2cyclictest278535-21kworker/u16:0+flush-8:006:47:326
83500993735,2cyclictest359372-21kworker/u16:1+flush-8:005:45:255
83506993631,4cyclictest188118-21latency_hist04:12:147
83501993633,2cyclictest470741-21kworker/u16:3+flush-8:006:57:316
83500993633,2cyclictest651629-21kworker/u16:3+events_unbound08:07:165
83497993633,2cyclictest278535-21kworker/u16:0+flush-8:005:52:334
83500993533,2cyclictest470741-21kworker/u16:3+events_unbound07:09:315
83500993533,2cyclictest278535-21kworker/u16:0+flush-8:005:38:255
83500993533,2cyclictest278535-21kworker/u16:0+events_unbound05:14:095
83500993533,2cyclictest104189-21kworker/u16:3+events_unbound03:31:255
83500993532,2cyclictest460156-21kworker/u16:1+flush-8:006:32:145
83500993432,2cyclictest460156-21kworker/u16:1+events_unbound06:32:135
83500993432,2cyclictest308936-21kworker/u16:3+flush-8:006:02:485
83500993432,2cyclictest278535-21kworker/u16:0+events_unbound04:59:005
83500993432,2cyclictest167650-21kworker/u16:1+events_unbound04:13:495
83500993432,2cyclictest148288-21kworker/u16:2+events_unbound03:55:105
83500993431,2cyclictest560989-21kworker/u16:1+events_unbound07:22:235
83497993432,2cyclictest521055-21kworker/u16:4+flush-8:007:07:134
83506993327,5cyclictest4184977-17auditd05:50:047
83501993330,2cyclictest470741-21kworker/u16:3+flush-8:007:07:276
83500993331,2cyclictest721791-21kworker/u16:3+events_unbound08:43:135
83500993331,2cyclictest601972-21kworker/u16:1+flush-8:007:37:575
83500993331,2cyclictest52105-21kworker/u16:4+events_unbound03:48:295
83500993331,2cyclictest52105-21kworker/u16:4+events_unbound03:38:295
83500993331,2cyclictest470741-21kworker/u16:3+events_unbound06:53:495
83500993331,2cyclictest167650-21kworker/u16:1+events_unbound04:40:265
83497993331,2cyclictest278535-21kworker/u16:0+flush-8:006:12:374
83497993331,2cyclictest128946-21kworker/u16:0+flush-8:004:32:374
83501993230,2cyclictest278535-21kworker/u16:0+events_unbound05:27:326
83497993230,2cyclictest128946-21kworker/u16:0+flush-8:004:42:374
83497993229,2cyclictest4155589-21kworker/u16:0+events_unbound03:22:314
83497993229,2cyclictest148288-21kworker/u16:2+events_unbound03:52:334
83501993129,2cyclictest278535-21kworker/u16:0+events_unbound05:02:316
83501993129,2cyclictest167650-21kworker/u16:1+events_unbound04:22:276
83501993129,2cyclictest148288-21kworker/u16:2+flush-8:003:57:276
83500993129,2cyclictest653104-21kworker/u16:4+events_unbound08:23:295
83500993129,2cyclictest653104-21kworker/u16:4+events_unbound08:23:295
83500993129,2cyclictest167650-21kworker/u16:1+events_unbound04:46:495
83500993128,2cyclictest653104-21kworker/u16:4+events_unbound08:17:165
83497993128,2cyclictest52105-21kworker/u16:4+flush-8:003:42:264
83501993029,1cyclictest308936-21kworker/u16:3+events_unbound05:52:376
83500993028,2cyclictest712878-21kworker/u16:2+events_unbound08:34:245
83500993028,2cyclictest653104-21kworker/u16:4+events_unbound08:17:085
83500993028,2cyclictest521054-21kworker/u16:0+events_unbound07:49:315
83500993028,2cyclictest521054-21kworker/u16:0+events_unbound07:43:175
83500993028,2cyclictest521054-21kworker/u16:0+events_unbound07:43:175
83500993028,2cyclictest460156-21kworker/u16:1+events_unbound06:41:405
83500993028,2cyclictest369563-21kworker/u16:2+flush-8:006:23:325
83500993028,2cyclictest369563-21kworker/u16:2+events_unbound06:08:235
83500993028,2cyclictest308936-21kworker/u16:3+flush-8:005:59:285
83500993028,2cyclictest288735-21kworker/u16:1+events_unbound05:20:325
83500993028,2cyclictest26655-21kworker/u16:2+events_unbound03:23:225
83500993028,2cyclictest258395-21kworker/u16:2+events_unbound04:50:205
83500993028,2cyclictest167650-21kworker/u16:1+flush-8:004:35:205
83500993028,2cyclictest167650-21kworker/u16:1+flush-8:004:22:535
83500993028,2cyclictest128946-21kworker/u16:0+events_unbound04:06:165
83497993028,2cyclictest521055-21kworker/u16:4+events_unbound07:27:264
83506992924,4cyclictest551080-21latency_hist07:12:137
83500992927,2cyclictest470741-21kworker/u16:3+events_unbound07:03:125
83500992927,2cyclictest167650-21kworker/u16:1+flush-8:004:19:495
83500992927,2cyclictest128946-21kworker/u16:0+events_unbound04:28:235
83501992826,2cyclictest52105-21kworker/u16:4+flush-8:003:27:336
83501992826,2cyclictest167650-21kworker/u16:1+events_unbound04:37:486
83500992826,2cyclictest712878-21kworker/u16:2+events_unbound08:51:125
83500992826,2cyclictest651629-21kworker/u16:3+events_unbound08:04:125
83500992826,2cyclictest560989-21kworker/u16:1+events_unbound07:30:005
83500992826,2cyclictest278535-21kworker/u16:0+flush-8:006:46:045
83506992722,4cyclictest561193-21latency_hist07:17:137
83501992724,2cyclictest571210-21kworker/u16:2+flush-8:007:22:306
83500992725,2cyclictest721791-21kworker/u16:3+flush-8:008:41:365
83500992725,2cyclictest521054-21kworker/u16:0+events_unbound07:34:365
83500992725,2cyclictest52105-21kworker/u16:4+events_unbound03:43:245
83500992725,2cyclictest439137-21kworker/u16:4+events_unbound06:18:405
83500992725,2cyclictest328883-21kworker/u16:2+events_unbound05:23:325
83500992725,2cyclictest308936-21kworker/u16:3+events_unbound05:28:485
83500992725,2cyclictest278535-21kworker/u16:0+events_unbound05:33:145
83500992725,2cyclictest167650-21kworker/u16:1+events_unbound04:11:055
83497992723,3cyclictest692892-21kworker/u16:0+events_unbound08:22:324
83497992723,3cyclictest692892-21kworker/u16:0+events_unbound08:22:324
83501992624,2cyclictest167650-21kworker/u16:1+flush-8:004:07:296
83500992624,2cyclictest601972-21kworker/u16:1+events_unbound07:53:175
83500992624,2cyclictest148288-21kworker/u16:2+events_unbound03:59:335
83497992624,2cyclictest278535-21kworker/u16:0+flush-8:005:07:294
83497992623,3cyclictest702320-21kworker/u16:1+flush-8:008:47:344
83497992623,2cyclictest521054-21kworker/u16:0+events_unbound07:52:254
2888722260,1chrt288867-21munin-plugin-st05:02:137
83501992523,2cyclictest521054-21kworker/u16:0+flush-8:007:17:286
83500992523,2cyclictest521054-21kworker/u16:0+events_unbound07:15:275
83501992422,2cyclictest369563-21kworker/u16:2+events_unbound06:07:346
83500992422,2cyclictest601972-21kworker/u16:1+events_unbound08:01:365
83497992422,2cyclictest581198-21kworker/u16:3+events_unbound07:37:434
3605962240,1chrt0-21swapper/605:37:306
83506992317,5cyclictest702562-21latency_hist08:27:137
83506992317,5cyclictest702562-21latency_hist08:27:137
83501992320,2cyclictest308936-21kworker/u16:3+flush-8:005:12:306
83501992320,2cyclictest278535-21kworker/u16:0+flush-8:005:42:446
83500992321,2cyclictest369563-21kworker/u16:2+events_unbound05:53:335
83500992321,2cyclictest260197-21kworker/u16:4+events_unbound04:53:455
83497992321,2cyclictest97834-21kworker/u16:1+events_unbound03:37:444
83497992321,2cyclictest188511-21kworker/u16:2+flush-8:004:22:384
83497992320,3cyclictest278535-21kworker/u16:0+flush-8:005:02:444
83501992220,2cyclictest52105-21kworker/u16:4+flush-8:003:47:446
83500992220,2cyclictest26655-21kworker/u16:2+flush-8:003:32:495
83501992119,2cyclictest470741-21kworker/u16:3+flush-8:007:02:326
83501992119,2cyclictest278535-21kworker/u16:0+events_unbound06:42:466
83501992118,2cyclictest260197-21kworker/u16:4+flush-8:004:54:006
83500992119,2cyclictest359372-21kworker/u16:1+flush-8:005:50:365
83497992118,3cyclictest167650-21kworker/u16:1+flush-8:004:07:394
83506992015,4cyclictest520847-21latency_hist06:57:137
83501992018,2cyclictest52105-21kworker/u16:4+events_unbound03:42:296
83501992018,2cyclictest369563-21kworker/u16:2+flush-8:006:32:296
83501992017,2cyclictest653104-21kworker/u16:4+flush-8:008:12:136
83497992018,2cyclictest308936-21kworker/u16:3+flush-8:005:12:404
83497992017,2cyclictest521054-21kworker/u16:0+flush-8:007:32:294
8350699190,17cyclictest692505-21latency_hist08:22:137
83501991917,2cyclictest661141-21kworker/u16:5+events_unbound08:12:386
83501991917,2cyclictest653104-21kworker/u16:4+events_unbound08:17:396
83501991917,2cyclictest128946-21kworker/u16:0+flush-8:004:02:346
83501991917,2cyclictest128946-21kworker/u16:0+flush-8:003:52:406
83501991916,2cyclictest167650-21kworker/u16:1+events_unbound04:12:336
83497991917,2cyclictest470741-21kworker/u16:3+flush-8:006:35:374
83497991917,2cyclictest258395-21kworker/u16:2+events_unbound04:47:344
83497991917,2cyclictest128946-21kworker/u16:0+flush-8:003:57:354
83497991916,2cyclictest369563-21kworker/u16:2+events_unbound06:27:304
83497991915,3cyclictest521055-21kworker/u16:4+events_unbound07:42:364
83497991915,3cyclictest521055-21kworker/u16:4+events_unbound07:42:364
83506991813,4cyclictest589235-21systemd-journal05:37:147
83506991813,4cyclictest167987-21latency_hist04:02:147
83501991816,2cyclictest52105-21kworker/u16:4+flush-8:003:37:396
83501991816,2cyclictest104189-21kworker/u16:3+flush-8:003:32:326
83501991815,2cyclictest369563-21kworker/u16:2+flush-8:006:55:466
83497991816,2cyclictest653104-21kworker/u16:4+events_unbound08:07:314
83497991816,2cyclictest439137-21kworker/u16:4+events_unbound06:17:494
83497991815,3cyclictest521055-21kworker/u16:4+flush-8:007:12:314
83497991815,2cyclictest278535-21kworker/u16:0+flush-8:004:59:364
83506991712,4cyclictest308995-21latency_hist05:12:137
8350699170,1cyclictest0-21swapper/707:37:417
83497991715,2cyclictest721791-21kworker/u16:3+flush-8:008:42:354
83497991715,2cyclictest651629-21kworker/u16:3+flush-8:008:02:384
83497991715,2cyclictest328883-21kworker/u16:2+flush-8:005:27:444
8350699166,8cyclictest0-21swapper/708:37:337
83506991614,1cyclictest0-21swapper/703:52:367
83506991612,3cyclictest0-21swapper/708:02:137
83506991610,5cyclictest430007-21latency_hist06:12:137
83501991614,2cyclictest712878-21kworker/u16:2+events_unbound08:37:336
83501991614,2cyclictest460156-21kworker/u16:1+flush-8:006:37:446
83501991614,2cyclictest328883-21kworker/u16:2+flush-8:005:22:426
83501991614,2cyclictest278535-21kworker/u16:0+events_unbound05:32:456
83497991614,2cyclictest581198-21kworker/u16:3+events_unbound07:47:264
83497991614,2cyclictest52105-21kworker/u16:4+flush-8:004:02:294
83497991614,2cyclictest359372-21kworker/u16:1+flush-8:006:02:334
83497991614,2cyclictest278535-21kworker/u16:0+flush-8:006:07:394
83497991613,3cyclictest167650-21kworker/u16:1+flush-8:004:37:404
83497991612,3cyclictest521055-21kworker/u16:4+flush-8:007:21:284
8349799160,1cyclictest0-21swapper/406:23:344
8350699159,5cyclictest178040-21latency_hist04:07:147
8350699155,8cyclictest27759-21gdbus06:28:037
83506991513,1cyclictest0-21swapper/708:32:397
83506991513,1cyclictest0-21swapper/707:17:397
83506991512,2cyclictest4175659-21snmpd05:18:117
8350699150,14cyclictest4175659-21snmpd06:52:017
8350699150,14cyclictest0-21swapper/703:27:377
8350699150,13cyclictest0-21swapper/706:42:407
83501991513,2cyclictest601972-21kworker/u16:1+events_unbound08:02:366
83501991513,2cyclictest521055-21kworker/u16:4+events_unbound07:12:446
83501991512,3cyclictest278535-21kworker/u16:0+flush-8:004:57:336
83501991512,2cyclictest128946-21kworker/u16:0+flush-8:004:42:426
83500991513,2cyclictest521054-21kworker/u16:0+events_unbound06:58:265
83497991513,2cyclictest97834-21kworker/u16:1+flush-8:003:47:354
83497991512,3cyclictest470741-21kworker/u16:3+flush-8:006:37:404
83497991512,2cyclictest26655-21kworker/u16:2+flush-8:003:32:394
8350699148,5cyclictest450220-21latency_hist06:22:137
8350699148,5cyclictest359432-21latency_hist05:37:137
8350699148,5cyclictest147902-21latency_hist03:52:137
8350699147,6cyclictest589235-21systemd-journal05:12:137
83506991412,1cyclictest0-21swapper/708:12:407
83506991412,1cyclictest0-21swapper/707:42:377
83506991412,1cyclictest0-21swapper/707:42:377
83506991411,2cyclictest4175659-21snmpd07:58:087
83506991411,2cyclictest4175659-21snmpd07:50:387
83506991411,2cyclictest4175659-21snmpd05:46:247
83506991411,2cyclictest0-21swapper/708:27:337
83506991411,2cyclictest0-21swapper/705:02:417
8350699141,11cyclictest0-21swapper/704:27:407
8350699140,13cyclictest984960-21gvfsd-wsdd04:25:187
83501991412,2cyclictest177110-21kworker/u16:3+flush-8:004:19:016
83501991412,2cyclictest167650-21kworker/u16:1+flush-8:004:32:286
83501991412,1cyclictest746124-21kthreadcore08:47:366
83501991410,3cyclictest560989-21kworker/u16:1+flush-8:007:27:396
83497991412,1cyclictest0-21swapper/405:57:414
83497991411,3cyclictest359372-21kworker/u16:1+flush-8:005:37:294
83497991411,2cyclictest702320-21kworker/u16:1+flush-8:008:35:044
8350699138,4cyclictest238443-21latency_hist04:37:137
8350699138,4cyclictest0-21swapper/706:22:147
8350699137,5cyclictest589235-21systemd-journal03:35:237
8350699136,6cyclictest208217-21turbostat04:22:147
8350699130,1cyclictest0-21swapper/703:42:347
8350699130,11cyclictest641746-21sshd-session07:55:257
83501991311,2cyclictest591858-21kworker/u16:2+flush-8:007:32:436
83501991311,2cyclictest258395-21kworker/u16:2+flush-8:004:47:416
83501991310,2cyclictest359372-21kworker/u16:1+flush-8:005:47:356
8349799138,4cyclictest219464-21cat04:27:294
83497991311,2cyclictest460156-21kworker/u16:1+events_unbound06:42:314
83497991310,2cyclictest278535-21kworker/u16:0+flush-8:006:47:264
8350699129,2cyclictest4175659-21snmpd08:50:157
8350699129,2cyclictest4175659-21snmpd08:46:037
8350699129,2cyclictest4175659-21snmpd07:36:027
8350699129,2cyclictest4175659-21snmpd07:30:147
8350699129,2cyclictest4175659-21snmpd05:22:177
8350699129,2cyclictest4175659-21snmpd04:55:597
8350699128,3cyclictest948-21NetworkManager06:32:267
8350699128,3cyclictest0-21swapper/704:47:147
8350699126,5cyclictest127736-21latency_hist03:42:137
8350699125,2cyclictest0-21swapper/703:22:397
8350699120,4cyclictest530798-21taskset07:00:537
8350699120,3cyclictest411486-21kthreadcore06:02:367
8350699120,11cyclictest672300-21latency_hist08:12:137
8350699120,11cyclictest589356-21tuned-ppd05:28:137
8350199129,2cyclictest369563-21kworker/u16:2+flush-8:005:57:386
83501991210,2cyclictest653104-21kworker/u16:4+events_unbound08:32:286
83501991210,2cyclictest278535-21kworker/u16:0+flush-8:006:22:306
8350199120,1cyclictest0-21swapper/605:21:056
8349799129,2cyclictest470741-21kworker/u16:3+events_unbound06:52:354
83497991211,1cyclictest0-21swapper/408:17:314
83497991210,2cyclictest278535-21kworker/u16:0+flush-8:005:32:314
8350699118,2cyclictest4175659-21snmpd06:14:097
8350699114,6cyclictest0-21swapper/704:44:257
8350699110,3cyclictest246834-21tr04:37:397
8350699110,1cyclictest0-21swapper/707:02:427
8350199119,2cyclictest631561-21kworker/u16:2+flush-8:007:57:296
83501991110,1cyclictest0-21swapper/607:50:416
83501991110,1cyclictest0-21swapper/605:09:346
8350199110,1cyclictest0-21swapper/606:29:496
8350199110,1cyclictest0-21swapper/606:21:376
8349799119,2cyclictest278535-21kworker/u16:0+flush-8:005:42:304
8349799119,2cyclictest258395-21kworker/u16:2+events_unbound04:52:374
83497991110,1cyclictest0-21swapper/408:29:024
83497991110,1cyclictest0-21swapper/407:11:564
8349799110,11cyclictest0-21swapper/404:20:354
8350699107,2cyclictest4175659-21snmpd05:57:217
8350199109,1cyclictest0-21swapper/608:25:226
8350199109,1cyclictest0-21swapper/608:25:226
8350199108,2cyclictest4155589-21kworker/u16:0+flush-8:003:22:396
8350199107,3cyclictest278535-21kworker/u16:0+events_unbound06:12:316
8350199100,0cyclictest0-21swapper/607:53:226
8349799108,2cyclictest661141-21kworker/u16:5+events_unbound08:12:364
8349799108,2cyclictest278535-21kworker/u16:0+flush-8:005:17:414
8349799106,3cyclictest189310-21cat04:12:284
835019998,1cyclictest0-21swapper/604:31:256
835019997,2cyclictest359372-21kworker/u16:1+events_unbound06:02:336
834979997,1cyclictest0-21swapper/407:57:304
834979996,2cyclictest308936-21kworker/u16:3+flush-8:005:47:234
835019986,1cyclictest0-21swapper/608:42:366
834979986,1cyclictest0-21swapper/407:22:334
835019962,3cyclictest702976-21cpu08:27:286
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional