You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 13:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Mar 10, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
86185123940,6sleep20-21swapper/219:06:442
9915272570,5chrt0-21swapper/221:11:592
10550222570,2sleep0141ktimers/022:16:480
866131995248,3cyclictest3666370-21kworker/u8:1+events_unbound19:15:050
866131995242,7cyclictest957133-21latency_hist20:40:010
866133995147,3cyclictest1081674-21kworker/u8:2+events_unbound23:06:461
866133995145,4cyclictest922434-21kworker/u8:0+flush-8:020:26:561
866133995143,6cyclictest1066835-21latency_hist22:30:011
11619882490,6sleep20-21swapper/200:06:442
9555642480,6sleep20-21swapper/220:36:482
866133994839,7cyclictest280-21systemd-journal22:40:001
866131994839,7cyclictest1131373-21latency_hist23:35:010
866136994741,4cyclictest280-21systemd-journal19:15:002
866133994738,6cyclictest1051727-21latency_hist22:15:011
866133994640,4cyclictest878325-21kworker/u8:2+events_unbound20:51:571
866131994641,4cyclictest1116210-21kworker/u8:3+flush-8:023:41:440
866133994539,4cyclictest878325-21kworker/u8:2+events_unbound19:36:411
866136994335,6cyclictest932439-21turbostat.cron20:15:002
866133994338,4cyclictest878325-21kworker/u8:2+flush-8:020:11:551
866131994237,3cyclictest1171002-21kworker/u8:0+flush-8:000:16:530
866131994236,5cyclictest952135-21kworker/u8:3+flush-8:021:36:550
86613199420,40cyclictest907746-21munin-run19:50:010
86613199420,40cyclictest907746-21munin-run19:50:000
866133994136,4cyclictest3666370-21kworker/u8:1+flush-8:019:16:471
866131994135,4cyclictest1032199-21kworker/u8:2+flush-8:022:26:460
866131994033,5cyclictest972180-21kworker/u8:1+flush-8:021:41:580
866131994030,7cyclictest1146833-21diskstats23:51:420
866136993935,3cyclictest3666370-21kworker/u8:1+events_unbound20:06:562
866131993934,4cyclictest1141023-21kworker/u8:1+flush-8:000:36:570
866131993927,9cyclictest280-21systemd-journal21:04:440
866131993927,5cyclictest972180-21kworker/u8:1+events_unbound21:15:010
866133993834,3cyclictest3666370-21kworker/u8:1+flush-8:020:21:591
866133993831,5cyclictest1141023-21kworker/u8:1+flush-8:023:51:461
866131993833,4cyclictest922434-21kworker/u8:0+events_unbound20:55:000
86613199381,34cyclictest1136344-21/usr/sbin/munin23:40:010
866131993733,3cyclictest952135-21kworker/u8:3+events_unbound20:41:470
866131993733,3cyclictest3666370-21kworker/u8:1+events_unbound19:41:420
866131993733,3cyclictest1141023-21kworker/u8:1+flush-8:023:56:450
866131993732,4cyclictest1032199-21kworker/u8:2+events_unbound22:00:000
866131993731,4cyclictest1071730-21kworker/u8:1+events_unbound23:21:430
866131993631,4cyclictest972180-21kworker/u8:1+events_unbound21:51:540
866133993531,3cyclictest922434-21kworker/u8:0+flush-8:020:46:431
866133993530,4cyclictest922434-21kworker/u8:0+flush-8:021:22:021
866133993530,4cyclictest878325-21kworker/u8:2+flush-8:019:56:571
866133993528,5cyclictest1176336-21apt-get00:21:381
866131993531,3cyclictest1041859-21awk22:05:000
866131993530,4cyclictest1161986-21sshd00:06:440
866131993530,3cyclictest1081674-21kworker/u8:2+events_unbound23:06:420
866131993523,10cyclictest280-21systemd-journal22:51:440
866131993522,5cyclictest972180-21kworker/u8:1+events_unbound21:46:520
866133993428,4cyclictest280-21systemd-journal19:53:401
866133993424,7cyclictest1082000-21/usr/sbin/munin22:46:481
866131993429,4cyclictest1071730-21kworker/u8:1+flush-8:023:01:480
866131993429,3cyclictest922434-21kworker/u8:0+events_unbound21:23:450
866131993427,5cyclictest1081674-21kworker/u8:2+flush-8:022:56:550
866131993425,7cyclictest972299-21/usr/sbin/munin20:56:570
866136993329,3cyclictest888201-21kworker/u8:3+events_unbound19:50:012
866133993329,3cyclictest3666370-21kworker/u8:1+flush-8:019:21:431
866133993328,4cyclictest1071730-21kworker/u8:1+flush-8:022:41:561
866133993328,3cyclictest1036923-21cron22:00:001
866133993327,4cyclictest280-21systemd-journal22:07:431
866131993329,2cyclictest1146211-21idleruntime-cro23:50:000
866131993319,4cyclictest3666370-21kworker/u8:1+events_unbound20:21:550
866136993228,3cyclictest1141023-21kworker/u8:1+events_unbound23:42:122
866136993224,6cyclictest976990-21base6421:00:012
866136993224,6cyclictest883647-21tr19:26:402
866136993212,10cyclictest0-21swapper/219:46:452
866136993212,10cyclictest0-21swapper/219:46:452
866133993227,4cyclictest922434-21kworker/u8:0+events_unbound21:01:561
866133993227,3cyclictest902807-21idleruntime-cro19:45:001
866131993228,3cyclictest3666370-21kworker/u8:1+flush-8:019:31:560
866131993225,5cyclictest878325-21kworker/u8:2+events_unbound20:11:410
866131993223,7cyclictest1171002-21kworker/u8:0+flush-8:000:26:500
866136993127,3cyclictest1141023-21kworker/u8:1+events_unbound00:27:132
866133993126,4cyclictest1091559-21cron22:55:001
866133993125,5cyclictest878325-21kworker/u8:2+events_unbound20:20:011
866133993125,4cyclictest922434-21kworker/u8:0+flush-8:022:01:511
866133993125,4cyclictest1156127-21systemd-run00:00:001
866131993125,5cyclictest3666370-21kworker/u8:1+events_unbound19:26:400
866131993125,4cyclictest878325-21kworker/u8:2+flush-8:019:51:460
866131993125,4cyclictest878325-21kworker/u8:2+events_unbound20:01:550
866133993026,3cyclictest1081674-21kworker/u8:2+events_unbound23:11:441
866133993026,3cyclictest1027036-21apt-key21:50:001
866133993026,2cyclictest0-21swapper/123:05:001
866133993025,4cyclictest1121235-21kworker/u8:0+flush-8:023:27:001
866133993025,3cyclictest952135-21kworker/u8:3+flush-8:021:36:461
866133993025,3cyclictest401-21dbus-daemon19:31:521
866133993025,3cyclictest0-21swapper/121:00:011
866133993024,5cyclictest878325-21kworker/u8:2+flush-8:020:01:521
866133993021,7cyclictest1170971-21cron00:15:001
866133993019,9cyclictest1130522-21ntpq23:31:491
866131993026,2cyclictest1046802-21munin-plugin-st22:10:000
866131993024,4cyclictest1121235-21kworker/u8:0+flush-8:023:26:430
866133992924,4cyclictest972180-21kworker/u8:1+flush-8:021:51:461
866133992924,3cyclictest952574-21aten2_r5power_c20:36:401
866133992924,3cyclictest1081674-21kworker/u8:2+events_unbound23:16:461
866133992922,5cyclictest996589-21unixbench_singl21:16:591
866131992925,2cyclictest1060998-21needreboot22:21:490
866131992923,4cyclictest972180-21kworker/u8:1+flush-8:021:06:540
866131992923,4cyclictest1071730-21kworker/u8:1+events_unbound22:41:500
866136992824,3cyclictest922434-21kworker/u8:0+events_unbound23:11:492
866136992823,3cyclictest1176554-21cpuspeed_turbos00:21:412
866133992821,6cyclictest1191454-21aten2_r5power_p00:36:401
866133992820,6cyclictest280-21systemd-journal20:31:431
866133992818,8cyclictest280-21systemd-journal21:26:431
866131992823,4cyclictest3666370-21kworker/u8:1+events_unbound19:21:560
866131992823,4cyclictest1116210-21kworker/u8:3+flush-8:000:31:500
866131992823,4cyclictest1081674-21kworker/u8:2+flush-8:023:16:570
866131992820,6cyclictest878325-21kworker/u8:2+flush-8:020:16:550
86613199281,26cyclictest834467-21kworker/0:1+events19:40:000
8657612282,6sleep00-21swapper/019:07:510
86613699275,10cyclictest39-21ksoftirqd/222:36:442
866136992723,3cyclictest922434-21kworker/u8:0+events_unbound20:03:462
866136992723,3cyclictest3666370-21kworker/u8:1+events_unbound19:30:132
866136992723,2cyclictest971606-21unixbench_multi20:51:582
866136992723,2cyclictest1150821-21unixbench_multi23:51:582
866136992723,2cyclictest1031651-21unixbench_singl21:51:592
866136992722,3cyclictest1160760-21unixbench_multi00:01:582
866136992720,5cyclictest1041587-21unixbench_singl22:01:582
866136992715,10cyclictest1056901-21awk22:20:002
86613699270,6cyclictest1133496-21cut23:36:462
866133992723,3cyclictest972180-21kworker/u8:1+flush-8:021:10:161
866133992723,3cyclictest870674-21unixbench_multi19:11:571
866133992723,3cyclictest1116210-21kworker/u8:3+events_unbound00:31:551
866133992723,2cyclictest0-21swapper/119:50:001
866133992723,2cyclictest0-21swapper/119:50:001
866133992722,4cyclictest1081674-21kworker/u8:2+flush-8:000:06:471
866133992722,3cyclictest1096734-21awk23:00:001
866133992721,4cyclictest1081674-21kworker/u8:2+events_unbound23:46:581
86613399271,24cyclictest1185858-21munin-run00:30:001
866131992722,4cyclictest922434-21kworker/u8:0+events_unbound20:46:440
866131992722,3cyclictest1047456-21fschecks_count22:11:420
866131992721,5cyclictest922434-21kworker/u8:0+events_unbound22:46:530
866131992721,4cyclictest952135-21kworker/u8:3+events_unbound21:26:490
866131992720,6cyclictest1081674-21kworker/u8:2+flush-8:000:11:540
9844162260,6sleep20-21swapper/221:06:452
866136992622,3cyclictest1171002-21kworker/u8:0+flush-8:000:16:512
866136992622,3cyclictest1016871-21awk21:40:002
866136992618,6cyclictest997826-21fschecks_time21:21:442
866133992622,3cyclictest1161099-21munin-run00:05:001
866133992621,3cyclictest961211-21needreboot20:41:511
866133992621,3cyclictest922434-21kworker/u8:0+events_unbound21:06:451
866133992619,6cyclictest1032199-21kworker/u8:2+events_unbound22:31:421
866131992623,2cyclictest927523-21systemd-run20:10:010
866131992620,4cyclictest878325-21kworker/u8:2+events_unbound20:30:010
8614442265,13sleep10-21swapper/119:06:411
10087652260,2sleep00-21swapper/021:31:470
866136992517,2cyclictest161rcu_preempt23:06:412
866136992516,2cyclictest161rcu_preempt23:56:452
866136992511,2cyclictest161rcu_preempt22:34:332
866136992511,2cyclictest161rcu_preempt19:24:552
86613699250,14cyclictest877851-21munin-run19:20:002
866133992521,3cyclictest1071730-21kworker/u8:1+flush-8:023:21:571
866133992519,5cyclictest1011953-21cron21:35:001
866133992518,5cyclictest3666370-21kworker/u8:1+flush-8:020:06:571
866131992519,4cyclictest1032199-21kworker/u8:2+events_unbound22:31:520
86613699243,6cyclictest0-21swapper/222:25:532
866136992421,2cyclictest1126859-21aten2_r5power_e23:31:392
866136992420,3cyclictest1081674-21kworker/u8:2+events_unbound22:47:032
866136992420,2cyclictest1141845-21cpuspeed_turbos23:46:412
866136992411,2cyclictest161rcu_preempt23:17:342
866136992410,2cyclictest161rcu_preempt20:29:472
866136992410,2cyclictest161rcu_preempt00:14:202
86613699240,13cyclictest1091577-21munin-plugin-st22:55:002
86613699240,13cyclictest1011642-21grep21:31:582
86613699240,11cyclictest1188126-21kthreadcore00:31:462
866133992420,3cyclictest1081674-21kworker/u8:2+events_unbound23:36:421
866131992420,3cyclictest972180-21kworker/u8:1+events_unbound21:18:440
866131992420,2cyclictest1076725-21sendmail22:40:000
86613699237,3cyclictest9131122grep19:56:412
86613699235,8cyclictest936567-21ntpq20:16:522
86613699233,5cyclictest902541-21seq19:41:582
866136992319,3cyclictest972180-21kworker/u8:1+events_unbound21:46:482
866136992319,2cyclictest1017377-21aten2_r5power_v21:41:412
86613699230,8cyclictest958832-21kthreadcore20:41:482
86613699230,11cyclictest1097127-21apt-get23:01:392
866133992320,2cyclictest1137409-21irqrtprio23:41:431
866133992319,2cyclictest0-21swapper/121:41:431
866133992318,3cyclictest883481-21aten2_r5power_e19:26:391
866133992318,3cyclictest1057635-21fschecks_time22:21:431
866133992318,3cyclictest1054489-21kthreadcore22:16:481
866131992320,2cyclictest1141023-21kworker/u8:1+events_unbound00:01:550
866131992319,3cyclictest878325-21kworker/u8:2+flush-8:019:55:300
866131992317,4cyclictest922434-21kworker/u8:0+flush-8:020:31:580
866131992316,6cyclictest922434-21kworker/u8:0+flush-8:023:15:000
86613699228,2cyclictest161rcu_preempt20:21:552
86613699226,6cyclictest0-21swapper/221:26:522
86613699223,4cyclictest0-21swapper/220:31:412
86613699223,2cyclictest0-21swapper/222:06:582
866136992210,1cyclictest161rcu_preempt21:02:332
86613699220,8cyclictest1079990-21cut22:41:502
86613699220,7cyclictest1051721-21ls22:15:002
86613699220,6cyclictest1061869-21turbostat.cron22:25:002
866131992216,4cyclictest1116210-21kworker/u8:3+flush-8:000:21:460
86613699216,2cyclictest39-21ksoftirqd/220:46:412
86613699214,7cyclictest0-21swapper/221:16:522
86613699214,6cyclictest0-21swapper/200:38:362
866136992110,2cyclictest161rcu_preempt22:59:422
86613699210,5cyclictest1122707-21irqrtprio23:26:472
86613699210,5cyclictest1118056-21cut23:21:452
866133992115,5cyclictest1171002-21kworker/u8:0+events_unbound00:16:431
866131992116,3cyclictest866599-21cpuspeed_turbos19:11:410
86613699209,2cyclictest161rcu_preempt21:58:102
86613699209,1cyclictest161rcu_preempt19:35:262
8657272194,8sleep30-21swapper/319:07:263
10329872160,2chrt481ktimers/321:56:463
9365362142,8sleep30-21swapper/320:16:523
11392072140,3chrt75-21kworker/3:1-mm_percpu_wq23:41:463
9275252132,6sleep30-21swapper/320:10:023
8707972132,7sleep30-21swapper/319:12:403
11861302130,2sleep375-21kworker/3:1+events00:30:003
11718392132,7sleep30-21swapper/300:16:453
11012122132,7sleep30-21swapper/323:01:583
10870562132,7sleep30-21swapper/322:51:433
10569042132,6sleep30-21swapper/322:20:013
10373262133,6sleep30-21swapper/322:01:403
9919682122,5sleep30-21swapper/321:15:013
9873102122,6sleep30-21swapper/321:10:443
9725732122,6sleep30-21swapper/320:56:443
9708712122,6sleep30-21swapper/320:51:503
9620692122,6sleep30-21swapper/320:45:003
9434272122,6sleep30-21swapper/320:26:473
8948462123,5sleep30-21swapper/319:36:473
8879892122,5sleep30-21swapper/319:30:013
8833242122,6sleep30-21swapper/319:25:403
11863882122,6sleep30-21swapper/300:31:383
11808832122,6sleep30-21swapper/300:25:003
11653282122,6sleep30-21swapper/300:06:543
11560672123,6sleep30-21swapper/300:00:003
11462032122,5sleep30-21swapper/323:50:013
11439352120,2sleep375-21kworker/3:1+mm_percpu_wq23:46:473
11271852123,6sleep30-21swapper/323:31:443
11242142123,6sleep30-21swapper/323:26:503
11066372122,5sleep30-21swapper/323:10:013
11023172122,6sleep30-21swapper/323:06:443
10770962122,6sleep30-21swapper/322:41:403
10676832120,8sleep30-21swapper/322:31:453
10312382122,6sleep30-21swapper/321:51:573
10204752122,6sleep30-21swapper/321:41:513
10076452122,6sleep30-21swapper/321:31:433
9974112112,5sleep30-21swapper/321:20:433
9829112112,5sleep30-21swapper/321:06:433
9815182112,5sleep30-21swapper/321:01:573
9624712112,5sleep30-21swapper/320:46:413
9521982112,4sleep30-21swapper/320:35:013
9475122112,5sleep30-21swapper/320:30:443
9380042112,5sleep30-21swapper/320:21:453
9228052112,5sleep30-21swapper/320:05:323
9179782112,5sleep30-21swapper/320:01:393
9134322112,5sleep30-21swapper/319:56:453
9080982112,5sleep30-21swapper/319:51:403
8981992112,5sleep30-21swapper/319:41:373
8784442112,6sleep30-21swapper/319:21:393
8733172112,5sleep30-21swapper/319:16:453
11950602112,5sleep30-21swapper/300:36:513
11667942112,6sleep30-21swapper/300:11:443
11569082112,5sleep30-21swapper/300:01:453
11322342112,5sleep30-21swapper/323:36:453
11118792112,5sleep30-21swapper/323:16:403
10921782112,5sleep30-21swapper/322:56:413
10816702112,5sleep30-21swapper/322:45:013
10719802112,5sleep30-21swapper/322:35:023
10625312112,5sleep30-21swapper/322:26:443
10521832112,5sleep30-21swapper/322:15:043
10510112112,5sleep30-21swapper/322:11:553
10418852112,5sleep30-21swapper/322:05:013
10225062112,5sleep30-21swapper/321:46:433
10121932112,6sleep30-21swapper/321:35:083
10030432110,7sleep30-21swapper/321:26:453
9030352102,5sleep30-21swapper/319:45:023
9030352102,5sleep30-21swapper/319:45:023
11167172102,5sleep30-21swapper/323:20:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional