You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 09:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Sep 16, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32976121960,2sleep375-21kworker/3:1-events19:19:073
51885421890,3sleep375-21kworker/3:1+events22:29:053
53269321870,2sleep375-21kworker/3:1-events22:40:013
4574832740,3chrt451irq_work/321:24:183
321905996646,7cyclictest567337-21latency_hist23:15:000
321905996050,8cyclictest428082-21cp20:55:010
321908995851,5cyclictest398402-21kworker/u8:3+flush-8:022:09:201
321908995753,3cyclictest547777-21kworker/u8:2+events_unbound22:59:171
321908995650,4cyclictest547777-21kworker/u8:2+flush-8:023:24:191
321910995448,4cyclictest637601-21gpgv00:25:002
321910995448,4cyclictest637601-21gpgv00:25:002
321908995347,4cyclictest378397-21kworker/u8:1+events_unbound20:14:041
321908995246,5cyclictest502393-21kworker/u8:1+flush-8:022:14:141
321908995146,3cyclictest333865-21kworker/u8:0+events_unbound19:34:061
321908995145,5cyclictest613022-21kworker/u8:4+flush-8:000:29:201
321908995046,3cyclictest344106-21kworker/u8:2+events_unbound20:29:091
321908995043,5cyclictest398402-21kworker/u8:3+events_unbound21:09:081
321905995040,7cyclictest507683-21latency_hist22:15:010
321908994940,7cyclictest408095-21latency_hist20:35:011
321905994939,8cyclictest651898-21ntpq00:39:150
321908994844,3cyclictest567296-21kworker/u8:0+events_unbound23:29:021
321908994843,4cyclictest4162117-21kworker/u8:1+events_unbound19:29:081
321908994842,4cyclictest583206-21kworker/u8:1+flush-8:023:39:181
321908994840,6cyclictest617730-21latency_hist00:05:011
321908994840,6cyclictest512638-21latency_hist22:20:011
321905994839,6cyclictest388266-21latency_hist20:15:010
321908994741,4cyclictest321772-21kworker/u8:3+flush-8:019:24:071
321908994740,5cyclictest398402-21kworker/u8:3+events_unbound20:39:041
321908994642,3cyclictest398402-21kworker/u8:3+flush-8:021:29:201
321908994539,5cyclictest462861-21kworker/u8:2+flush-8:021:44:181
321905994538,5cyclictest344106-21kworker/u8:2+flush-8:020:49:060
5856512440,4sleep0585655-21kthreadcore23:34:100
321905994436,5cyclictest612820-21cat00:00:000
321908994339,3cyclictest462861-21kworker/u8:2+flush-8:022:04:071
321908994338,4cyclictest532717-21kworker/u8:1+events_unbound23:14:041
321908994338,4cyclictest398402-21kworker/u8:3+flush-8:021:49:191
321908994338,4cyclictest333865-21kworker/u8:0+events_unbound22:24:141
321908994338,3cyclictest423138-21kworker/u8:1+flush-8:021:04:181
321908994337,4cyclictest602992-21kworker/u8:1+flush-8:023:54:051
321908994330,10cyclictest278-21systemd-journal22:33:251
321908994237,4cyclictest462861-21kworker/u8:2+flush-8:021:39:211
321908994236,5cyclictest532717-21kworker/u8:1+events_unbound23:04:161
321908994236,4cyclictest344106-21kworker/u8:2+flush-8:019:39:171
321908994236,4cyclictest344106-21kworker/u8:2+flush-8:019:39:161
321905994232,8cyclictest398402-21kworker/u8:3+flush-8:020:39:060
321908994137,3cyclictest642611-21kworker/u8:0+events_unbound00:34:031
321908994137,3cyclictest333865-21kworker/u8:0+events_unbound20:09:071
321908994136,4cyclictest613022-21kworker/u8:4+flush-8:000:14:131
321908994136,4cyclictest344106-21kworker/u8:2+events_unbound19:54:041
321908994136,4cyclictest333865-21kworker/u8:0+flush-8:022:49:041
321908994135,5cyclictest333865-21kworker/u8:0+flush-8:022:29:181
321908994135,4cyclictest333865-21kworker/u8:0+flush-8:022:44:181
321908994134,5cyclictest592553-21kworker/u8:3+flush-8:023:59:201
321908994132,7cyclictest322301-21/usr/sbin/munin19:14:171
321908994130,9cyclictest637493-21apt-get00:25:001
321908994130,9cyclictest637493-21apt-get00:25:001
321908994036,3cyclictest547777-21kworker/u8:2+flush-8:023:09:061
321908994036,3cyclictest344106-21kworker/u8:2+flush-8:020:44:081
321908994036,3cyclictest344106-21kworker/u8:2+flush-8:020:44:081
321908994035,4cyclictest567296-21kworker/u8:0+events_unbound23:40:021
321908994035,4cyclictest423138-21kworker/u8:1+flush-8:020:59:051
321908994034,5cyclictest547777-21kworker/u8:2+flush-8:023:19:151
321908994034,5cyclictest547777-21kworker/u8:2+events_unbound00:19:051
321908994034,5cyclictest547777-21kworker/u8:2+events_unbound00:19:051
321908994034,5cyclictest321772-21kworker/u8:3+flush-8:019:44:191
321908994034,4cyclictest321772-21kworker/u8:3+events_unbound19:49:171
321910993934,3cyclictest321772-21kworker/u8:3+events_unbound19:15:022
321908993933,4cyclictest567296-21kworker/u8:0+flush-8:023:34:091
321908993831,5cyclictest398402-21kworker/u8:3+flush-8:021:19:161
321908993830,6cyclictest547777-21kworker/u8:2+flush-8:023:49:121
321908993829,6cyclictest278-21systemd-journal20:16:251
321905993829,6cyclictest278-21systemd-journal21:05:000
321905993828,7cyclictest632544-21latency_hist00:20:010
321905993828,7cyclictest632544-21latency_hist00:20:000
5770712370,6sleep3451irq_work/323:24:183
321908993732,3cyclictest512903-21kworker/u8:3+events_unbound22:39:171
321908993731,5cyclictest333865-21kworker/u8:0+events_unbound20:54:161
321905993727,8cyclictest597203-21ntpq23:44:150
32190599372,29cyclictest321735-21kworker/0:2+events20:05:370
321910993627,7cyclictest338774-21base6419:25:002
321908993632,3cyclictest378397-21kworker/u8:1+events_unbound20:24:081
321908993632,3cyclictest333865-21kworker/u8:0+events_unbound20:49:111
321908993631,4cyclictest333865-21kworker/u8:0+flush-8:021:34:061
321908993631,4cyclictest333865-21kworker/u8:0+events_unbound22:54:111
321908993630,4cyclictest642611-21kworker/u8:0+events_unbound00:39:181
321908993629,6cyclictest398402-21kworker/u8:3+events_unbound21:14:021
32190599351,32cyclictest492619-21kworker/0:0+events22:39:010
3172482353,9sleep10-21swapper/119:07:141
321910993424,8cyclictest448100-21awk21:15:002
321908993429,3cyclictest398402-21kworker/u8:3+flush-8:021:54:101
321905993426,6cyclictest373431-21latency_hist20:00:010
321905993411,14cyclictest567487-21kworker/0:0+events23:24:010
321905993325,6cyclictest453848-21diskstats21:24:040
321905993324,6cyclictest472777-21latency_hist21:40:010
32190599332,25cyclictest537445-21kworker/0:1+events22:55:010
321908993228,3cyclictest462861-21kworker/u8:2+events_unbound21:59:091
321905993226,4cyclictest278-21systemd-journal22:00:050
321905993224,6cyclictest278-21systemd-journal19:50:000
321910993125,4cyclictest412325-21needreboot20:39:122
32190599313,26cyclictest321735-21kworker/0:2+events19:34:170
3811642300,2sleep375-21kworker/3:1+events20:09:103
321910993025,4cyclictest333865-21kworker/u8:0+flush-8:021:39:442
321910993024,4cyclictest398402-21kworker/u8:3+events_unbound21:15:052
321908993025,4cyclictest321772-21kworker/u8:3+flush-8:019:59:151
321905993025,3cyclictest417943-21cron20:45:000
321905993025,3cyclictest417943-21cron20:45:000
32190599302,26cyclictest567487-21kworker/0:0+events23:19:010
321905993022,6cyclictest453023-21latency_hist21:20:010
32190599301,27cyclictest321735-21kworker/0:2+events20:34:010
32190599300,28cyclictest567487-21kworker/0:0+events23:49:090
321910992918,8cyclictest353684-21awk19:40:002
321910992918,8cyclictest353684-21awk19:40:002
321908992924,4cyclictest4162117-21kworker/u8:1+events_unbound19:19:441
321908992923,4cyclictest333865-21kworker/u8:0+flush-8:021:24:101
32190599294,20cyclictest537445-21kworker/0:1+events23:01:490
321905992925,2cyclictest326991-21latency_hist19:15:010
321905992923,3cyclictest459064-21irqcore21:29:080
32190599292,26cyclictest321735-21kworker/0:2+events19:24:210
321905992922,5cyclictest487036-21ntpq21:54:130
32190599292,25cyclictest321735-21kworker/0:2+events20:24:090
321905992919,8cyclictest432431-21ntpq20:59:130
321905992918,9cyclictest0-21swapper/000:09:130
32190599291,26cyclictest567487-21kworker/0:0+events00:04:010
321910992825,2cyclictest647514-21unixbench_singl00:34:192
321910992822,4cyclictest506984-21needreboot22:14:112
321908992824,3cyclictest547777-21kworker/u8:2+flush-8:000:09:251
321908992823,3cyclictest374084-21aten2_r5power_p20:04:041
32190599286,21cyclictest472834-21kworker/0:1+events21:43:130
32190599285,18cyclictest567487-21kworker/0:0+events23:51:210
321905992824,2cyclictest0-21swapper/021:10:010
32190599282,25cyclictest537445-21kworker/0:1+events22:49:090
321905992818,8cyclictest377719-21ntpq20:04:140
321905992811,15cyclictest321735-21kworker/0:2+events19:54:130
32190599280,26cyclictest321735-21kworker/0:2+events19:19:330
321910992722,3cyclictest542194-21unixbench_multi22:49:192
321910992719,7cyclictest527503-21cron22:35:002
32190599277,15cyclictest472834-21kworker/0:1+events21:46:370
32190599276,19cyclictest321735-21kworker/0:2+events21:14:570
32190599272,24cyclictest567487-21kworker/0:0+events00:12:290
321905992721,4cyclictest588217-21/usr/sbin/munin23:39:120
321905992717,8cyclictest578276-21munin-node23:28:580
32190599271,25cyclictest567487-21kworker/0:0+events00:29:090
321905992711,14cyclictest492619-21kworker/0:0+events22:24:010
321910992622,2cyclictest573219-21aten2_r5power_p23:24:032
321905992621,3cyclictest511950-21needreboot22:19:120
321905992619,5cyclictest344106-21kworker/u8:2+flush-8:019:39:190
321905992619,5cyclictest344106-21kworker/u8:2+flush-8:019:39:190
32190599261,23cyclictest537445-21kworker/0:1+events23:08:010
321910992522,2cyclictest467750-21unixbench_singl21:34:212
321910992521,2cyclictest568356-21cpuspeed_turbos23:19:022
321910992521,2cyclictest403977-21fschecks_count20:34:062
321910992519,4cyclictest508460-21cpuspeed_turbos22:19:032
321910992518,5cyclictest567776-21cp23:15:002
321910992517,7cyclictest427845-21ls20:55:002
321910992515,8cyclictest363561-21/usr/sbin/munin19:50:012
321910992514,8cyclictest433072-21awk21:00:002
32190599257,17cyclictest492619-21kworker/0:0+events22:08:570
321905992520,4cyclictest512903-21kworker/u8:3+events_unbound22:34:020
321910992419,3cyclictest462794-21unixbench_singl21:29:212
321910992414,8cyclictest397620-21ntpq20:24:162
321910992413,9cyclictest278-21systemd-journal22:55:002
321910992413,8cyclictest373437-21awk20:00:002
32190599247,16cyclictest458016-21kworker/0:0+events21:34:170
321905992419,4cyclictest20865-21cron00:35:000
321905992419,3cyclictest0-21swapper/019:44:160
321910992318,4cyclictest333865-21kworker/u8:0+events_unbound20:05:262
32190599238,14cyclictest492619-21kworker/0:0+events22:44:570
32190599238,13cyclictest321735-21kworker/0:2+events19:25:010
32190599235,16cyclictest321735-21kworker/0:2+events20:25:010
321905992320,2cyclictest547329-21idleruntime-cro22:55:000
321905992318,3cyclictest637718-21latency_hist00:25:000
321905992318,3cyclictest637718-21latency_hist00:25:000
3171652233,3sleep00-21swapper/019:06:090
321910992218,3cyclictest498429-21fschecks_time22:09:072
321910992218,2cyclictest651840-21needreboot00:39:142
321910992217,4cyclictest453907-21cut21:24:052
321910992214,6cyclictest384811-21kthreadcore20:14:092
321910992213,7cyclictest437851-21unixbench_multi21:04:202
32190599226,15cyclictest321735-21kworker/0:2+events20:16:500
321905992218,3cyclictest492601-21sendmail22:00:000
32190599220,21cyclictest492619-21kworker/0:0+events22:26:450
32191099212,18cyclictest0-21swapper/220:49:192
32191099212,14cyclictest618297-21apt-get00:09:022
32191099212,14cyclictest583264-21apt-get23:34:032
321910992117,2cyclictest623473-21cpuspeed_turbos00:14:032
321910992117,2cyclictest0-21swapper/200:05:002
321910992116,3cyclictest0-21swapper/219:55:002
321910992113,7cyclictest355164-21kthreadcore19:44:072
32191099208,4cyclictest0-21swapper/223:59:132
32191099202,13cyclictest603321-21apt-get23:54:022
321910992017,2cyclictest488447-21cpuspeed_turbos21:59:032
321910992017,2cyclictest399079-21fschecks_time20:29:072
321910992016,2cyclictest321772-21kworker/u8:3+events_unbound19:25:082
321910992016,2cyclictest0-21swapper/221:10:002
321910992012,6cyclictest532361-21unixbench_singl22:39:202
321910992011,7cyclictest475538-21kthreadcore21:44:122
3173532204,12sleep20-21swapper/219:08:362
32191099193,11cyclictest642054-21ntpq00:29:132
32191099192,16cyclictest0-21swapper/220:44:182
32191099192,16cyclictest0-21swapper/220:44:182
32191099192,12cyclictest548105-21apt-get22:59:012
321910991914,4cyclictest20865-21cron00:20:002
321910991914,4cyclictest20865-21cron00:20:002
321910991911,6cyclictest522387-21unixbench_multi22:29:182
3211872193,9sleep30-21swapper/319:09:173
32191099182,11cyclictest598363-21apt-get23:49:012
321910991814,3cyclictest0-21swapper/220:20:002
321910991813,3cyclictest0-21swapper/222:04:072
321910991812,4cyclictest592725-21gpgv23:40:012
321910991811,6cyclictest557485-21cron23:05:002
3493152172,9sleep30-21swapper/319:39:033
3493152172,9sleep30-21swapper/319:39:023
32191099179,6cyclictest515934-21cut22:24:102
32191099172,1cyclictest0-21swapper/219:34:212
321910991713,2cyclictest0-21swapper/223:09:002
321910991712,3cyclictest0-21swapper/222:44:072
321910991712,3cyclictest0-21swapper/219:14:092
321910991711,4cyclictest0-21swapper/221:49:102
321910991710,5cyclictest579618-21cut23:29:072
321910991710,5cyclictest376565-21tr20:04:122
32191099162,13cyclictest0-21swapper/223:43:102
321910991613,2cyclictest0-21swapper/221:54:212
4374492153,8sleep30-21swapper/321:04:163
6259272142,8sleep30-21swapper/300:14:113
5530912142,8sleep30-21swapper/323:04:053
4970002142,8sleep30-21swapper/322:04:153
3780822145,5sleep30-21swapper/320:04:223
6133412132,7sleep30-21swapper/300:04:043
6069462132,7sleep30-21swapper/323:54:133
5975782130,2sleep3471rcuc/323:44:213
5826892132,6sleep30-21swapper/323:30:013
5423722132,6sleep30-21swapper/322:50:013
4798522132,7sleep30-21swapper/321:49:103
4634442132,7sleep30-21swapper/321:34:023
4130672132,6sleep30-21swapper/320:40:013
4130672132,6sleep30-21swapper/320:40:013
3448112133,6sleep30-21swapper/319:34:093
3255482133,6sleep30-21swapper/319:14:113
6481522122,6sleep30-21swapper/300:39:023
6471012122,6sleep30-21swapper/300:34:173
6423282122,6sleep30-21swapper/300:29:193
6325522122,6sleep30-21swapper/300:20:013
6325522122,6sleep30-21swapper/300:20:013
6188072122,6sleep30-21swapper/300:09:093
5879202123,5sleep30-21swapper/323:35:113
5786912122,6sleep30-21swapper/323:29:053
5679532122,6sleep30-21swapper/323:17:013
5339312122,6sleep30-21swapper/322:44:073
5134762122,6sleep30-21swapper/322:24:053
5029542122,6sleep30-21swapper/322:10:253
4737282122,6sleep30-21swapper/321:44:093
4585662122,6sleep30-21swapper/321:29:043
4484952122,6sleep30-21swapper/321:17:243
4475262122,6sleep30-21swapper/321:14:153
4385712122,6sleep30-21swapper/321:09:073
4122332122,6sleep30-21swapper/320:39:133
4050152122,6sleep30-21swapper/320:34:113
3985792122,6sleep30-21swapper/320:27:253
3890672122,6sleep30-21swapper/320:19:073
3844812122,6sleep30-21swapper/320:14:093
3690172123,5sleep30-21swapper/319:59:003
3581062122,6sleep30-21swapper/319:44:163
3398082122,6sleep30-21swapper/319:29:073
3338882122,6sleep30-21swapper/319:20:243
6319072112,5sleep30-21swapper/300:19:123
6319072112,5sleep30-21swapper/300:19:123
6077082112,5sleep30-21swapper/323:55:013
5986012112,5sleep30-21swapper/323:49:033
5629352112,5sleep30-21swapper/323:14:013
5579472112,6sleep30-21swapper/323:07:583
5478182113,5sleep30-21swapper/322:55:363
5376572112,6sleep30-21swapper/322:45:073
5228172112,6sleep30-21swapper/322:30:313
5082572112,6sleep30-21swapper/322:19:033
4981192112,5sleep30-21swapper/322:09:043
4879982112,5sleep30-21swapper/321:56:243
4829792112,6sleep30-21swapper/321:50:353
4682402112,6sleep30-21swapper/321:36:583
4283072112,5sleep30-21swapper/320:55:063
4232602112,6sleep30-21swapper/320:51:413
4182512113,5sleep30-21swapper/320:45:593
3981582112,5sleep30-21swapper/320:25:003
3640232112,6sleep30-21swapper/319:53:153
3589632112,6sleep30-21swapper/319:46:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional