You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 01:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri May 22, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2411225846,8sleep40-21swapper/419:04:304
24631995453,0cyclictest0-21swapper/722:13:017
2411524232,7sleep50-21swapper/519:04:315
242802415,31sleep70-21swapper/719:06:497
628089400,33rtkit-daemon0-21swapper/619:03:036
24631993735,1cyclictest0-21swapper/721:53:227
24631993732,4cyclictest153315-21latency_hist20:12:337
24631993635,0cyclictest0-21swapper/721:02:587
24631993534,0cyclictest0-21swapper/723:48:257
24631993534,0cyclictest0-21swapper/722:36:537
24631993433,0cyclictest0-21swapper/722:55:217
24631993432,1cyclictest680177-21ssh23:58:457
24631993432,1cyclictest535818-21ssh22:59:467
24631993332,0cyclictest0-21swapper/723:45:307
24631993332,0cyclictest0-21swapper/723:07:227
24631993332,0cyclictest0-21swapper/722:05:547
24631993332,0cyclictest0-21swapper/721:59:067
24631993332,0cyclictest0-21swapper/721:59:067
24631993332,0cyclictest0-21swapper/700:04:497
24631993332,0cyclictest0-21swapper/700:04:497
24622993331,2cyclictest115192-21kworker/u16:0+events_unbound20:52:585
24631993227,4cyclictest706334-21latency_hist00:12:327
24631993130,0cyclictest0-21swapper/722:45:507
24631993130,0cyclictest0-21swapper/722:08:507
24631993130,0cyclictest0-21swapper/721:19:457
24631993130,0cyclictest0-21swapper/721:19:457
24631993130,0cyclictest0-21swapper/700:16:507
24631993129,1cyclictest596778-21sh23:25:497
24631993129,1cyclictest596778-21sh23:25:497
24631993029,0cyclictest0-21swapper/700:35:377
24631992928,0cyclictest0-21swapper/723:56:257
24631992928,0cyclictest0-21swapper/722:40:257
24631992928,0cyclictest0-21swapper/700:30:097
24631992827,0cyclictest0-21swapper/722:51:057
24631992827,0cyclictest0-21swapper/721:33:147
24631992827,0cyclictest0-21swapper/721:26:397
24631992827,0cyclictest0-21swapper/721:16:067
24631992726,0cyclictest0-21swapper/723:32:217
24631992726,0cyclictest0-21swapper/723:18:267
24631992726,0cyclictest0-21swapper/721:41:017
24631992726,0cyclictest0-21swapper/721:12:317
24622992725,2cyclictest537309-21kworker/u16:3+events_unbound23:18:015
24631992625,0cyclictest0-21swapper/723:16:177
24626992624,2cyclictest115192-21kworker/u16:0+events_unbound21:12:496
24631992524,0cyclictest0-21swapper/723:10:177
24626992524,1cyclictest39069-21kworker/u16:3+events_unbound19:37:466
2463199240,22cyclictest56058-21missed_timers19:18:087
24622992420,3cyclictest501478-21kworker/u16:1+flush-8:023:42:585
24631992322,0cyclictest0-21swapper/723:34:217
24631992322,0cyclictest0-21swapper/719:15:477
24631992221,0cyclictest0-21swapper/719:52:307
24631992120,0cyclictest0-21swapper/721:44:587
24631992120,0cyclictest0-21swapper/720:59:187
24614992119,2cyclictest4164394-21kworker/u16:4+events_unbound19:12:474
24614992118,2cyclictest501478-21kworker/u16:1+flush-8:000:12:374
24631992019,0cyclictest0-21swapper/723:41:537
24631991918,0cyclictest0-21swapper/721:47:367
24631991915,3cyclictest1234-21snmpd20:22:207
2463199190,17cyclictest0-21swapper/719:32:557
2461499190,1cyclictest0-21swapper/400:33:404
24631991814,3cyclictest124-21kswapd000:22:467
24626991815,2cyclictest2299872sleep620:49:356
24631991716,0cyclictest0-21swapper/722:29:217
24631991716,0cyclictest0-21swapper/720:52:317
24631991716,0cyclictest0-21swapper/719:11:197
24626991714,2cyclictest115192-21kworker/u16:0+flush-8:021:07:506
24622991713,3cyclictest105217-21kworker/u16:2+flush-8:019:52:585
24622991713,3cyclictest105217-21kworker/u16:2+flush-8:019:52:585
24614991714,2cyclictest110617-21cut19:47:504
24631991615,0cyclictest0-21swapper/722:22:237
24631991615,0cyclictest0-21swapper/721:30:457
24631991614,1cyclictest0-21swapper/720:05:337
24631991614,1cyclictest0-21swapper/719:29:507
24622991614,2cyclictest115192-21kworker/u16:0+events_unbound21:12:585
24622991613,2cyclictest67952-21kworker/u16:0+flush-8:019:28:355
24614991613,3cyclictest0-21swapper/423:26:394
24614991613,3cyclictest0-21swapper/423:26:394
2461499160,0cyclictest0-21swapper/422:05:184
24631991514,0cyclictest0-21swapper/722:26:267
24631991510,4cyclictest635-21systemd-journal19:22:337
2463199150,13cyclictest1448-21dockerd19:46:477
2462699150,14cyclictest0-21swapper/620:17:556
24622991511,3cyclictest630848-21ntpq23:37:575
24614991511,3cyclictest634409-21/usr/sbin/munin23:42:544
2461499150,1cyclictest0-21swapper/421:42:574
24631991413,0cyclictest0-21swapper/720:45:317
24631991413,0cyclictest0-21swapper/719:57:347
2463199140,1cyclictest0-21swapper/720:12:557
24626991413,1cyclictest0-21swapper/623:59:186
24626991413,1cyclictest0-21swapper/623:08:516
24626991413,1cyclictest0-21swapper/622:59:146
24626991410,3cyclictest416988-21cpuspeed_turbos22:12:446
2462699140,1cyclictest0-21swapper/623:35:406
2462699140,1cyclictest0-21swapper/621:28:076
2462699140,1cyclictest0-21swapper/600:12:526
2462699140,14cyclictest0-21swapper/623:44:016
2462699140,14cyclictest0-21swapper/621:50:216
2462699140,14cyclictest0-21swapper/621:22:456
2462699140,14cyclictest0-21swapper/619:52:536
2462699140,14cyclictest0-21swapper/619:52:536
24622991413,1cyclictest0-21swapper/523:52:565
24622991412,2cyclictest307663-21kworker/u16:4+flush-8:021:33:005
2462299140,1cyclictest0-21swapper/522:57:455
24614991413,1cyclictest0-21swapper/422:17:084
24614991413,1cyclictest0-21swapper/421:59:194
24614991413,1cyclictest0-21swapper/421:59:194
24614991413,1cyclictest0-21swapper/421:25:354
24614991411,2cyclictest356007-21kworker/u16:0+events_unbound22:57:474
2461499140,14cyclictest0-21swapper/423:35:014
2461499140,14cyclictest0-21swapper/423:17:214
2461499140,14cyclictest0-21swapper/421:47:584
2463199139,3cyclictest1234-21snmpd20:33:547
2463199137,5cyclictest211003-21latency_hist20:42:327
2463199137,5cyclictest211003-21latency_hist20:42:327
24631991312,0cyclictest0-21swapper/720:22:567
2462699139,3cyclictest192930-21cat20:32:466
2462699139,3cyclictest173757-21cat20:22:476
2462699138,4cyclictest345138-21cat21:42:466
24626991312,1cyclictest0-21swapper/623:17:516
24626991312,1cyclictest0-21swapper/622:25:586
24626991312,1cyclictest0-21swapper/621:55:526
24626991312,1cyclictest0-21swapper/621:33:286
24626991312,1cyclictest0-21swapper/619:32:336
24626991312,1cyclictest0-21swapper/600:29:446
2462699130,13cyclictest0-21swapper/623:27:096
2462699130,13cyclictest0-21swapper/623:27:096
2462699130,13cyclictest0-21swapper/622:49:096
2462699130,0cyclictest0-21swapper/622:32:366
24622991312,1cyclictest0-21swapper/521:44:455
24622991312,1cyclictest0-21swapper/500:11:045
24622991310,2cyclictest452823-21kworker/u16:4+flush-8:022:42:485
2462299130,13cyclictest0-21swapper/522:37:445
2462299130,13cyclictest0-21swapper/522:15:015
2462299130,13cyclictest0-21swapper/521:21:255
2462299130,13cyclictest0-21swapper/521:21:255
2462299130,13cyclictest0-21swapper/520:27:495
2462299130,13cyclictest0-21swapper/500:30:375
2462299130,0cyclictest0-21swapper/520:02:545
24614991312,1cyclictest0-21swapper/422:57:114
24614991312,1cyclictest0-21swapper/421:53:294
24614991312,1cyclictest0-21swapper/421:31:154
2461499130,1cyclictest0-21swapper/421:03:404
2461499130,13cyclictest0-21swapper/420:32:464
2461499130,12cyclictest0-21swapper/420:17:564
2463199129,2cyclictest1234-21snmpd19:40:477
2463199128,3cyclictest1234-21snmpd20:57:307
2463199128,3cyclictest1234-21snmpd19:57:147
2463199128,3cyclictest1234-21snmpd19:57:147
24631991210,1cyclictest0-21swapper/700:17:517
24626991211,1cyclictest0-21swapper/622:01:236
24626991211,1cyclictest0-21swapper/622:01:236
2462699120,1cyclictest0-21swapper/620:30:346
2462299128,3cyclictest474546-21kworker/u16:2+flush-8:022:52:595
2462299128,3cyclictest39069-21kworker/u16:3+flush-8:019:37:485
2462299127,3cyclictest0-21swapper/520:42:435
24622991211,1cyclictest0-21swapper/522:29:325
24622991211,1cyclictest0-21swapper/521:27:065
2461499128,3cyclictest550492-21tune2fs23:07:444
2461499126,5cyclictest0-21swapper/423:27:494
2461499126,5cyclictest0-21swapper/420:13:004
2461499125,6cyclictest284557-21cat21:17:474
2461499125,6cyclictest284557-21cat21:17:474
2461499124,2cyclictest238815-21ntp_kernel_err20:52:544
2461499123,4cyclictest201807-21cpu20:37:434
2461499123,4cyclictest201807-21cpu20:37:434
24614991211,1cyclictest0-21swapper/423:59:084
24614991211,1cyclictest0-21swapper/423:07:254
24614991211,1cyclictest0-21swapper/422:10:594
24614991211,1cyclictest0-21swapper/421:37:054
24614991211,1cyclictest0-21swapper/419:12:314
24614991210,2cyclictest0-21swapper/422:38:534
2461499120,1cyclictest0-21swapper/420:10:224
2461499120,1cyclictest0-21swapper/419:21:014
2462699118,2cyclictest731815-21perl00:22:466
2462699117,3cyclictest96777-21cat19:42:476
2462699117,3cyclictest207122-21cut20:37:506
2462699117,3cyclictest207122-21cut20:37:506
2462699117,3cyclictest157791-21kthreadcore20:12:516
2462699113,7cyclictest685185-21kthreadcore00:02:496
2462699113,7cyclictest685185-21kthreadcore00:02:496
24626991110,1cyclictest0-21swapper/622:40:486
24626991110,1cyclictest0-21swapper/621:39:096
24626991110,1cyclictest0-21swapper/619:09:326
2462699110,10cyclictest238851-21ntpq20:52:556
2462699110,0cyclictest0-21swapper/619:25:566
2462299118,3cyclictest295792-21kworker/u16:3+flush-8:021:53:055
2462299118,2cyclictest295792-21kworker/u16:3+flush-8:022:07:585
24622991110,1cyclictest0-21swapper/523:28:495
24622991110,1cyclictest0-21swapper/523:08:575
24622991110,1cyclictest0-21swapper/522:22:265
24622991110,1cyclictest0-21swapper/519:13:245
2462299110,11cyclictest0-21swapper/521:04:245
2462299110,11cyclictest0-21swapper/520:38:515
2462299110,11cyclictest0-21swapper/520:38:515
2462299110,11cyclictest0-21swapper/520:19:185
2462299110,11cyclictest0-21swapper/519:48:245
2462299110,11cyclictest0-21swapper/519:21:365
2461499116,1cyclictest0-21swapper/421:37:524
2461499115,1cyclictest0-21swapper/422:42:484
2461499115,1cyclictest0-21swapper/420:42:434
2461499115,1cyclictest0-21swapper/419:37:534
2461499115,1cyclictest0-21swapper/400:27:444
2461499115,1cyclictest0-21swapper/400:02:494
2461499115,1cyclictest0-21swapper/400:02:494
2461499114,3cyclictest244363-21kthreadcore20:57:524
2461499114,1cyclictest0-21swapper/422:47:514
2461499113,4cyclictest654790-21cat23:47:544
2461499113,4cyclictest280217-21open_files21:13:004
2461499113,3cyclictest72612-21cut19:27:514
2461499113,3cyclictest470986-21grep22:32:524
2461499113,3cyclictest430527-21grep22:17:484
2461499113,3cyclictest104688-21sed19:43:004
2461499113,2cyclictest695031-21cpuspeed_turbos00:07:444
2461499112,4cyclictest726371-21kthreadcore00:17:524
2461499112,4cyclictest659735-21cut23:52:494
2461499112,4cyclictest459782-21cut22:27:524
2461499112,4cyclictest441309-21grep22:22:444
2461499112,4cyclictest261183-21cut21:07:504
2461499112,4cyclictest175494-21grep20:22:494
2461499112,4cyclictest131514-21kthreadcore19:57:514
2461499112,3cyclictest121607-21kthreadcore19:52:534
2461499112,3cyclictest121607-21kthreadcore19:52:534
2461499111,4cyclictest737685-21tr00:22:524
2461499110,6cyclictest221929-21sed20:47:474
2461499110,11cyclictest0-21swapper/419:34:354
5384552106,3sleep6538611-21cat23:02:476
2463199107,3cyclictest5729-21ssh-agent20:28:007
2462699109,1cyclictest0-21swapper/621:07:096
2462699109,1cyclictest0-21swapper/619:19:186
2462699108,2cyclictest86-21ksoftirqd/622:43:196
2462699108,2cyclictest86-21ksoftirqd/622:07:546
2462699106,3cyclictest719995-21irqcore00:17:486
2462699105,4cyclictest430406-21cut22:17:486
2462699105,4cyclictest240876-21perl20:57:476
2462699105,4cyclictest125595-21cat19:57:466
2462699104,5cyclictest0-21swapper/621:17:516
2462699104,5cyclictest0-21swapper/621:17:516
2462699100,9cyclictest700999-21cut00:07:526
2462699100,9cyclictest654923-21ntpq23:47:566
2462699100,9cyclictest394249-21kthreadcore22:02:486
2462699100,4cyclictest76707-21/usr/sbin/munin19:32:456
2462699100,3cyclictest144698-21grep20:07:456
2462299109,1cyclictest0-21swapper/521:38:365
2462299109,1cyclictest0-21swapper/520:57:375
2462299102,5cyclictest448974-21tr22:22:535
2462299100,0cyclictest0-21swapper/520:33:115
2461499104,1cyclictest0-21swapper/419:22:494
2461499102,3cyclictest624310-21kthreadcore23:37:494
2461499102,3cyclictest186634-21grep20:27:504
2461499100,4cyclictest574657-21grep23:17:464
246269997,2cyclictest86-21ksoftirqd/623:37:476
246269996,2cyclictest0-21swapper/623:27:446
246269995,3cyclictest663711-21grep23:52:526
246269995,3cyclictest519179-21kthreadcore22:52:526
246269990,8cyclictest757940-21kthreadcore00:32:496
246269990,8cyclictest453879-21fschecks_time22:27:466
246269990,2cyclictest40347-21kthreadcore19:12:496
246229995,3cyclictest719741-21cat00:17:475
246229994,4cyclictest466142-21cat22:32:475
246149990,4cyclictest134925-21cat20:02:434
246269983,4cyclictest136028-21cut20:02:486
246269983,4cyclictest105883-21cut19:47:426
246269980,7cyclictest562800-21iptables23:12:476
246229987,1cyclictest0-21swapper/520:10:475
246229985,2cyclictest0-21swapper/521:07:545
246229984,3cyclictest708961-21kthreadcore00:12:495
246229984,3cyclictest565371-21cut23:12:505
246229983,4cyclictest731820-21gltestperf00:22:475
246229983,4cyclictest688078-21kthreadcore00:02:515
246229983,4cyclictest688078-21kthreadcore00:02:515
246229983,4cyclictest654701-21cat23:47:545
246229983,4cyclictest381143-21df_inode21:57:445
246229983,4cyclictest381143-21df_inode21:57:445
246229983,4cyclictest358868-21cut21:47:505
246229983,4cyclictest309064-21sed21:27:485
246229980,7cyclictest586367-21tr23:22:455
246229980,7cyclictest586367-21tr23:22:455
246269973,3cyclictest212173-21cat20:42:466
246229975,1cyclictest0-21swapper/520:22:445
246229975,1cyclictest0-21swapper/519:57:475
246229975,1cyclictest0-21swapper/519:07:505
246229974,2cyclictest670818-21cpuspeed_turbos23:57:435
246229973,3cyclictest99085-21cat19:42:505
246229973,3cyclictest77236-21forks19:32:455
246229973,3cyclictest610833-21expr23:32:445
246229973,3cyclictest537826-21cpu23:02:445
246229973,3cyclictest222251-21grep20:47:485
246229973,3cyclictest154367-21cut20:12:465
246229972,4cyclictest755286-21cat00:32:435
246229972,4cyclictest58713-21cut19:22:495
246229972,4cyclictest502680-21cut22:47:485
246229972,4cyclictest392739-21cpuspeed22:02:435
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional