You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 13:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 25, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
377669023520,6sleep3451irq_work/300:27:473
3458553996035,22cyclictest3519727-21latency_hist20:10:010
3458553995835,20cyclictest3504905-21latency_hist19:55:010
3458558995145,5cyclictest3421532-21kworker/u8:0+flush-8:020:02:521
3458558995144,5cyclictest3505135-21kworker/u8:3+events_unbound21:52:541
3458558995043,5cyclictest3589615-21kworker/u8:2+flush-8:022:22:541
3458558994842,4cyclictest3505135-21kworker/u8:3+events_unbound22:47:541
3458558994738,7cyclictest3718278-21latency_hist23:30:011
3458553994515,6cyclictest3593644-21sshd21:22:520
3458553994422,20cyclictest278-21systemd-journal22:05:510
3458558994334,6cyclictest3688662-21latency_hist23:00:001
3458558994233,6cyclictest278-21systemd-journal23:20:001
3458558994232,8cyclictest278-21systemd-journal22:10:521
3458553994224,16cyclictest3699311-21grep23:12:400
3458562994135,4cyclictest3505135-21kworker/u8:3+flush-8:020:57:532
3458558994134,5cyclictest3718546-21kworker/u8:0+events_unbound23:52:531
3458558994134,5cyclictest3589615-21kworker/u8:2+events_unbound23:57:521
3458553993920,17cyclictest395-21dbus-daemon20:50:000
3458553993826,9cyclictest278-21systemd-journal20:00:000
3458553993818,19cyclictest3757683-21unixbench_singl00:07:570
3458558993732,4cyclictest3505135-21kworker/u8:3+flush-8:021:02:411
3458558993732,4cyclictest3505135-21kworker/u8:3+flush-8:021:02:411
3458553993721,13cyclictest3463634-21latency_hist19:15:010
3458553993720,15cyclictest3778406-21cpuspeed_turbos00:32:390
3458553993719,3cyclictest3496207-21irqrtprio19:47:400
3458553993718,4cyclictest3658507-21unixbench_singl22:27:550
3458553993718,2cyclictest0-21swapper/021:27:390
3458553993717,5cyclictest395-21dbus-daemon23:05:010
3458553993717,5cyclictest395-21dbus-daemon23:05:000
3458553993717,2cyclictest0-21swapper/022:12:460
3458553993716,4cyclictest3678363-21unixbench_singl22:47:560
34648362360,6sleep2371rcuc/219:15:032
3458558993631,4cyclictest3421532-21kworker/u8:0+events_unbound21:12:521
3458558993630,4cyclictest3635197-21irqrtprio22:07:431
3458558993626,7cyclictest3782681-21latency_hist00:35:011
345855399364,3cyclictest3632911-21kthreadcore22:02:460
345855399364,3cyclictest3632911-21kthreadcore22:02:460
3458553993617,3cyclictest868-21mta-sts-daemon23:57:440
3458553993616,4cyclictest3479902-21unixbench_multi19:27:530
34757852350,12sleep3451irq_work/319:27:363
3458562993524,8cyclictest3634194-21cat22:05:002
3458562993524,8cyclictest3634194-21cat22:05:002
3458558993530,3cyclictest3505135-21kworker/u8:3+flush-8:021:42:431
3458558993529,4cyclictest3505135-21kworker/u8:3+flush-8:022:17:401
3458558993528,4cyclictest3480188-21kworker/u8:2+flush-8:019:35:011
3458558993525,7cyclictest278-21systemd-journal19:43:511
3458553993528,5cyclictest3733573-21apt-get23:47:370
3458553993525,8cyclictest3490503-21/usr/sbin/munin19:42:520
3458553993518,4cyclictest3524651-21cron20:15:000
3458553993517,2cyclictest0-21swapper/023:42:370
3458553993513,8cyclictest3773241-21apt-get00:27:380
3458553993510,11cyclictest3579960-21grep21:12:380
3458562993426,6cyclictest3777723-21awk00:30:002
3458558993427,5cyclictest3465839-21apt-get19:17:351
345855399342,8cyclictest575-21snmpd20:52:350
3458553993423,8cyclictest278-21systemd-journal19:36:500
3458553993418,2cyclictest0-21swapper/020:41:520
3458553993416,3cyclictest3768788-21sort00:22:410
3458553993416,3cyclictest3661758-21kthreadcore22:32:440
3458558993329,3cyclictest3421532-21kworker/u8:0+events_unbound19:57:531
3458558993325,6cyclictest3499954-21latency_hist19:50:011
3458553993326,5cyclictest3698524-21basename23:09:590
3458553993324,6cyclictest3624146-21latency_hist21:55:010
3458553993320,2cyclictest3629079-21sendmail22:00:000
3458553993314,3cyclictest0-21swapper/021:47:390
3458553993310,2cyclictest0-21swapper/023:36:310
3458558993227,4cyclictest3748236-21kworker/u8:4+flush-8:000:27:411
3458558993227,4cyclictest3411633-21kworker/u8:1+flush-8:020:47:441
3458558993224,6cyclictest3505135-21kworker/u8:3+flush-8:020:27:491
3458553993215,2cyclictest0-21swapper/000:17:510
3458553993214,3cyclictest3574317-21latency_hist21:05:000
3458553993214,3cyclictest3574317-21latency_hist21:05:000
3458562993125,4cyclictest3762851-21kworker/u8:0+flush-8:000:37:402
3458562993122,7cyclictest3643903-21awk22:15:002
3458558993123,6cyclictest278-21systemd-journal22:32:361
3458553993127,3cyclictest599-21sshd21:17:520
3458562993021,7cyclictest3634563-21aten2_r5power_p22:07:372
3458562993018,9cyclictest278-21systemd-journal00:10:012
3458558993023,5cyclictest3762851-21kworker/u8:0+events_unbound00:37:471
3458558993023,5cyclictest3421532-21kworker/u8:0+flush-8:020:22:511
3458558993022,6cyclictest3470769-21apt-get19:22:351
3458562992925,2cyclictest3708912-21aten2_r5power_e23:22:382
3458562992923,4cyclictest3603860-21unixbench_multi21:32:552
3458562992919,8cyclictest3733130-21turbostat.cron23:45:002
3458558992924,4cyclictest3668253-21kworker/u8:1+flush-8:022:52:401
3458558992924,3cyclictest3757920-21systemd-run00:10:001
3458558992923,4cyclictest3767836-21systemd-run00:20:011
3458558992923,4cyclictest3505135-21kworker/u8:3+flush-8:021:27:581
3458562992823,3cyclictest3654246-21aten2_r5power_c22:27:382
3458558992824,3cyclictest3589615-21kworker/u8:2+flush-8:023:42:501
3458558992823,4cyclictest3703238-21unixbench_singl23:12:551
3458558992820,6cyclictest3673625-21latency_hist22:45:011
3458558992819,7cyclictest3589054-21apt-get21:20:011
345855399288,18cyclictest3629120-21kworker/0:2+events22:22:530
3458562992724,2cyclictest3684457-21fschecks_time22:57:412
3458562992723,3cyclictest3689338-21cpuspeed_turbos23:02:392
3458562992723,3cyclictest3689338-21cpuspeed_turbos23:02:392
3458562992723,2cyclictest3584851-21fschecks_count21:17:402
3458562992719,6cyclictest3573433-21needreboot21:02:482
3458562992719,6cyclictest3573433-21needreboot21:02:482
3458562992718,7cyclictest3664398-21fschecks_count22:37:392
3458562992717,8cyclictest3495045-21cat19:45:002
3458562992716,9cyclictest3490074-21awk19:40:002
3458558992722,4cyclictest395-21dbus-daemon22:40:011
3458558992721,5cyclictest3505135-21kworker/u8:3+flush-8:020:42:561
3458558992721,4cyclictest3480188-21kworker/u8:2+flush-8:019:52:451
3458553992724,2cyclictest3568508-21needreboot20:57:470
345855399272,23cyclictest3448688-21kworker/0:1+events20:02:450
3458553992721,4cyclictest3534276-21unixbench_multi20:22:560
3458553992720,5cyclictest3713846-21aten2_r5power_e23:27:370
3458562992622,2cyclictest3674179-21aten2_r5power_v22:47:382
3458562992622,2cyclictest3549796-21aten2_r5power_c20:42:382
3458562992620,4cyclictest3628867-21unixbench_singl21:57:552
3458562992612,9cyclictest3604582-21apt-get21:37:382
3458558992622,2cyclictest3490105-21systemd-run19:40:001
3458558992620,3cyclictest0-21swapper/122:27:511
345855399265,17cyclictest3733150-21kworker/0:1+events23:50:010
3458553992617,7cyclictest3525084-21/usr/sbin/munin20:17:520
3458562992521,3cyclictest3762616-21unixbench_singl00:12:572
3458562992520,3cyclictest3574803-21aten2_r5power_v21:07:402
3458562992519,4cyclictest3564157-21unixbench_singl20:52:542
3458562992518,5cyclictest3704824-21kthreadcore23:17:432
345855899259,3cyclictest0-21swapper/100:12:541
3458558992522,2cyclictest3593987-21grep21:22:541
3458558992520,4cyclictest3505135-21kworker/u8:3+flush-8:020:12:481
3458558992520,3cyclictest3748744-21fschecks_time00:02:401
345855899251,9cyclictest3722491-21ntpq23:32:471
3458558992519,4cyclictest3505135-21kworker/u8:3+events_unbound20:57:501
3458558992519,3cyclictest0-21swapper/123:47:381
3458558992518,6cyclictest3421532-21kworker/u8:0+events_unbound20:07:421
3458553992517,6cyclictest3761876-21grep00:12:470
3458553992517,6cyclictest278-21systemd-journal20:30:000
3458562992421,2cyclictest3484856-21unixbench_multi19:32:562
3458562992420,3cyclictest3698291-21unixbench_singl23:07:552
3458562992420,3cyclictest3579760-21aten2_r5power_v21:12:372
3458562992420,2cyclictest3505569-21cpuspeed_turbos19:57:382
3458562992419,4cyclictest3505135-21kworker/u8:3+events_unbound20:10:012
3458562992419,3cyclictest3742766-21unixbench_singl23:52:562
3458562992418,4cyclictest3772528-21unixbench_multi00:22:532
3458562992416,6cyclictest3683563-21cp22:55:002
3458562992416,6cyclictest3500709-21fschecks_time19:52:402
3458558992420,2cyclictest0-21swapper/121:57:521
3458558992418,4cyclictest3540603-21irqrtprio20:32:411
3458558992418,4cyclictest3462677-21needreboot19:12:541
3458558992418,4cyclictest3421532-21kworker/u8:0+flush-8:020:17:441
3458558992418,3cyclictest0-21swapper/123:02:481
3458558992418,3cyclictest0-21swapper/123:02:481
3458558992417,5cyclictest3668253-21kworker/u8:1+flush-8:023:07:501
3458553992419,3cyclictest3421532-21kworker/u8:0+events_unbound21:10:010
3458553992416,5cyclictest278-21systemd-journal22:54:520
3458553992415,6cyclictest3609092-21latency_hist21:40:010
3458562992320,2cyclictest3479948-21unixbench_singl19:27:532
3458562992317,4cyclictest0-21swapper/222:32:452
345856299230,14cyclictest3558070-21kthreadcore20:47:442
3458558992319,2cyclictest0-21swapper/121:47:501
3458558992318,3cyclictest3505135-21kworker/u8:3+flush-8:020:37:541
345855399235,16cyclictest3448688-21kworker/0:1+events20:37:450
3458553992318,3cyclictest2649832-21kworker/u8:5+flush-8:019:20:010
3458553992317,4cyclictest3648611-21unixbench_singl22:17:550
3458553992315,6cyclictest3604141-21latency_hist21:35:010
345856299222,3cyclictest35123261runrttasks20:02:442
3458562992219,2cyclictest3778231-21aten2_r5power_e00:32:382
3458562992219,2cyclictest3614497-21aten2_r5power_c21:47:362
3458558992218,2cyclictest0-21swapper/121:32:391
3458558992218,2cyclictest0-21swapper/121:07:441
3458558992217,4cyclictest3505135-21kworker/u8:3+events_unbound21:37:541
3458558992216,4cyclictest3564136-21unixbench_multi20:52:541
3458558992216,4cyclictest3411633-21kworker/u8:1+events_unbound19:27:341
3458558992215,5cyclictest3589615-21kworker/u8:2+flush-8:023:37:421
345855399224,16cyclictest3663705-21kworker/0:0+events22:57:370
3458553992218,3cyclictest3610275-21sed21:42:420
3458553992218,2cyclictest0-21swapper/020:32:350
3458553992217,4cyclictest3722976-21unixbench_multi23:32:550
3458553992217,3cyclictest0-21swapper/023:22:460
3458562992118,2cyclictest3718943-21cpuspeed_turbos23:32:372
3458562992117,3cyclictest3496009-21ps19:47:402
3458562992117,2cyclictest3609613-21aten2_r5power_e21:42:372
3458562992115,4cyclictest3535895-21kthreadcore20:27:422
3458562992115,4cyclictest3530265-21cpuspeed_turbos20:22:392
3458558992113,5cyclictest0-21swapper/123:22:541
345855399216,14cyclictest3663705-21kworker/0:0+events22:42:450
3458553992116,3cyclictest0-21swapper/000:05:010
345856299202,2cyclictest0-21swapper/223:47:542
345856299202,13cyclictest3520172-21apt-get20:12:362
3458562992016,3cyclictest3748516-21aten2_r5power_p00:02:382
3458558992016,3cyclictest3589615-21kworker/u8:2+flush-8:022:02:401
3458558992016,3cyclictest3589615-21kworker/u8:2+flush-8:022:02:401
3458558992015,2cyclictest0-21swapper/100:22:391
3458553992015,3cyclictest0-21swapper/000:37:390
3458553992010,8cyclictest3470769-21apt-get19:22:370
34576752204,9sleep20-21swapper/219:07:502
34537882204,10sleep10-21swapper/119:05:161
3458562991915,3cyclictest0-21swapper/200:00:002
3458562991915,2cyclictest3594941-21cpuspeed_turbos21:27:392
3458562991914,4cyclictest3762851-21kworker/u8:0+flush-8:000:15:312
3458562991914,4cyclictest0-21swapper/220:17:532
3458562991914,3cyclictest0-21swapper/223:27:552
3458562991911,6cyclictest3544539-21grep20:35:012
3458562991911,2cyclictest36458921kthreadcore22:17:432
345855399193,15cyclictest3448688-21kworker/0:1+events19:32:450
3458553991914,4cyclictest3668253-21kworker/u8:1+flush-8:023:16:230
34540512193,8sleep30-21swapper/319:07:393
3458562991814,2cyclictest0-21swapper/221:52:422
3458562991813,3cyclictest0-21swapper/223:40:012
3458562991812,3cyclictest3462675-21grep19:12:542
345855399188,8cyclictest3666929-21tr22:37:450
345856299171,7cyclictest0-21swapper/222:42:422
3458562991712,3cyclictest0-21swapper/222:22:452
345856299170,5cyclictest35928851kthreadcore21:22:452
345856299170,2cyclictest35454172irqcore20:37:422
345856299168,6cyclictest0-21swapper/219:22:462
345856299167,7cyclictest3700861-21cut23:12:442
34539462153,7sleep00-21swapper/019:07:200
37300942144,6sleep30-21swapper/323:42:423
37867722132,7sleep30-21swapper/300:37:473
36887402132,6sleep30-21swapper/323:00:013
36887402132,6sleep30-21swapper/323:00:013
36695592132,7sleep30-21swapper/322:42:403
36587122130,9sleep30-21swapper/322:30:013
36458412133,6sleep30-21swapper/322:17:443
36340202132,6sleep30-21swapper/322:05:013
35693482132,6sleep30-21swapper/321:00:013
35693482132,6sleep30-21swapper/321:00:013
35444082132,6sleep30-21swapper/320:35:013
35358582133,7sleep30-21swapper/320:27:433
34905322132,7sleep30-21swapper/319:42:373
34900492132,7sleep30-21swapper/319:40:013
34634612133,6sleep30-21swapper/319:15:013
37725102122,6sleep30-21swapper/300:22:543
37632092122,6sleep30-21swapper/300:17:013
37583502122,6sleep30-21swapper/300:12:393
37547692124,5sleep30-21swapper/300:07:463
37422652123,6sleep30-21swapper/323:52:493
37277892122,6sleep30-21swapper/323:37:573
37189732122,6sleep30-21swapper/323:32:393
37132382122,6sleep30-21swapper/323:23:533
37006212122,6sleep30-21swapper/323:12:453
36951782122,6sleep30-21swapper/323:07:443
36878732122,6sleep30-21swapper/322:57:493
36830212122,6sleep30-21swapper/322:52:553
36645882122,6sleep30-21swapper/322:37:423
36596082122,6sleep30-21swapper/322:32:413
36399532122,6sleep30-21swapper/322:12:443
36213542122,6sleep30-21swapper/321:52:453
36090782122,6sleep30-21swapper/321:40:013
36086152122,6sleep30-21swapper/321:37:563
35950982122,6sleep30-21swapper/321:27:413
35941902122,6sleep30-21swapper/321:24:163
35823352122,6sleep30-21swapper/321:12:453
35784672122,6sleep30-21swapper/321:07:513
35589382122,6sleep30-21swapper/320:47:533
35432162122,6sleep30-21swapper/320:32:463
35208922122,6sleep30-21swapper/320:12:423
35156142122,6sleep30-21swapper/320:07:413
35049322122,6sleep30-21swapper/319:55:013
34993372122,6sleep30-21swapper/319:47:513
34653122122,7sleep30-21swapper/319:15:053
37779562112,6sleep30-21swapper/300:30:093
37484242110,2chrt577-21kworker/3:2-events00:02:353
37433922112,6sleep30-21swapper/323:57:193
37333562112,6sleep30-21swapper/323:45:073
37135862112,6sleep30-21swapper/323:25:173
37038732112,6sleep30-21swapper/323:17:353
36739252112,6sleep30-21swapper/322:46:053
36491092112,6sleep30-21swapper/322:20:253
36293642112,6sleep30-21swapper/322:00:363
36293642112,6sleep30-21swapper/322:00:353
36245962112,5sleep30-21swapper/321:57:383
36142872112,6sleep30-21swapper/321:45:353
35995762112,6sleep30-21swapper/321:32:033
35871442112,5sleep30-21swapper/321:17:463
35646082112,6sleep30-21swapper/320:55:073
35601112112,6sleep30-21swapper/320:52:393
35495882112,6sleep30-21swapper/320:40:393
35298782112,6sleep30-21swapper/320:20:493
35249172112,6sleep30-21swapper/320:15:283
35101732112,6sleep30-21swapper/320:01:123
35042672112,5sleep30-21swapper/319:52:523
34849752112,6sleep30-21swapper/319:33:143
34706462112,6sleep30-21swapper/319:21:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional