You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 07:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Sep 15, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
65554423430,5sleep30-21swapper/321:19:053
57499521900,4sleep30-21swapper/319:54:203
58972521780,2sleep3471rcuc/320:09:203
7027802810,2chrt75-21kworker/3:1-events22:04:113
5655042750,2chrt75-21kworker/3:1+events19:45:003
5655042750,2chrt75-21kworker/3:1+events19:45:003
528734994334,7cyclictest719677-21/usr/sbin/munin22:24:160
52873499415,31cyclictest533689-21kworker/0:2+events22:57:430
528734994031,7cyclictest734793-21/usr/sbin/munin22:39:200
52873499400,38cyclictest1-21systemd23:20:000
5251132384,30sleep20-21swapper/219:09:102
528734993729,6cyclictest774059-21latency_hist23:15:010
5240652374,9sleep10-21swapper/119:07:151
528734993525,8cyclictest604451-21ntpq20:24:140
528734993522,11cyclictest278-21systemd-journal21:00:010
7017112340,7sleep20-21swapper/222:04:102
528736993428,4cyclictest610465-21kworker/u8:2+flush-8:020:49:121
528736993425,7cyclictest278-21systemd-journal21:35:001
528734993428,4cyclictest610465-21kworker/u8:2+flush-8:020:39:100
528734993424,7cyclictest693777-21ntpq21:54:140
528734993424,7cyclictest278-21systemd-journal23:30:000
528734993329,2cyclictest858177-21sendmail00:40:000
528734993327,4cyclictest560515-21munin-run19:40:000
528734993326,5cyclictest783339-21ntpq23:24:110
528734993326,5cyclictest676058-21kthreadcore21:39:100
528736993227,3cyclictest739210-21kworker/u8:1+flush-8:023:49:101
528736993226,4cyclictest755422-21irqcore22:59:081
528736993224,6cyclictest778375-21ntpq23:19:121
528736993126,3cyclictest780314-21irqrtprio23:24:051
528736993123,6cyclictest529421-21cpuspeed_turbos19:14:051
528736993123,6cyclictest528609-21kworker/u8:3+flush-8:019:29:201
528734993126,3cyclictest574651-21needreboot19:54:120
528734993121,7cyclictest569778-21ntpq19:49:150
528744993024,4cyclictest756039-21tr22:59:092
528736993026,2cyclictest644911-21systemd-run21:05:011
528736993025,3cyclictest707001-21kthreadcore22:09:111
528736993024,4cyclictest773948-21unixbench_singl23:14:201
528736993023,5cyclictest600663-21/usr/sbin/munin20:24:191
528734993026,2cyclictest718437-21needreboot22:19:120
528734993021,7cyclictest550403-21apt-get19:30:000
528744992923,5cyclictest486698-21kworker/u8:1+flush-8:020:49:202
528736992925,2cyclictest576622-21irqrtprio19:59:081
528736992922,5cyclictest744068-21unixbench_singl22:44:211
528736992921,6cyclictest560508-21latency_hist19:40:001
52873499295,22cyclictest533689-21kworker/0:2+events21:29:070
528734992925,3cyclictest749107-21turbostat.cron22:50:010
528734992924,3cyclictest815159-21kthreadcore23:59:080
528734992924,3cyclictest815159-21kthreadcore23:59:080
528734992921,6cyclictest749869-21/usr/sbin/munin22:54:110
528734992919,8cyclictest641412-21kthreadcore21:04:080
528744992823,4cyclictest674595-21kworker/u8:3+events_unbound21:55:002
528744992823,3cyclictest834260-21cpuspeed_turbos00:19:042
528744992823,3cyclictest670261-21aten2_r5power_p21:34:032
528736992821,5cyclictest680311-21cpuspeed_turbos21:44:031
528736992820,6cyclictest561082-21apt-get19:43:591
528736992820,6cyclictest561082-21apt-get19:43:591
528736992819,7cyclictest764379-21latency_hist23:05:011
528736992819,6cyclictest278-21systemd-journal22:49:261
528734992824,2cyclictest834528-21runrttasks00:19:070
528734992824,2cyclictest0-21swapper/020:20:000
528734992823,3cyclictest639949-21kworker/u8:1+events_unbound21:20:010
528734992823,3cyclictest1-21systemd19:15:010
528734992822,5cyclictest818662-21kworker/u8:3+flush-8:000:24:050
528734992819,7cyclictest853138-21unixbench_singl00:34:190
528734992818,8cyclictest804613-21diskstats23:49:040
528736992724,2cyclictest540552-21systemd-run19:20:001
528736992723,3cyclictest854542-21irqrtprio00:39:101
528736992722,4cyclictest659719-21idleruntime-cro21:20:001
528736992722,3cyclictest784887-21fschecks_time23:29:081
528736992722,3cyclictest774076-21kworker/u8:2+flush-8:000:05:001
528736992722,3cyclictest729930-21fschecks_time22:34:041
528736992722,3cyclictest551278-21aten2_r5power_p19:34:031
528736992722,3cyclictest0-21swapper/121:00:001
528736992721,4cyclictest590073-21unixbench_multi20:09:221
528736992719,6cyclictest739171-21latency_hist22:40:011
52873699271,11cyclictest693732-21ntpq21:54:131
528734992722,3cyclictest823593-21cron00:04:590
528734992722,3cyclictest670466-21fschecks_count21:34:050
528734992721,4cyclictest704285-21cron22:05:000
528744992622,2cyclictest794438-21aten2_r5power_c23:39:042
528744992622,2cyclictest659617-21unixbench_singl21:19:222
528744992621,3cyclictest556479-21fschecks_time19:39:052
528736992623,2cyclictest570428-21latency_hist19:50:001
528736992623,2cyclictest0-21swapper/122:14:011
528736992621,3cyclictest0-21swapper/122:55:001
528736992619,5cyclictest833363-21unixbench_singl00:14:211
528736992618,6cyclictest729009-21cron22:30:001
528736992617,7cyclictest699326-21latency_hist22:00:011
52873499264,18cyclictest533689-21kworker/0:2+events22:25:110
528734992623,2cyclictest734229-21latency_hist22:35:010
528734992623,2cyclictest611147-21fschecks_time20:34:060
528734992621,4cyclictest565390-21unixbench_singl19:44:190
528734992621,4cyclictest565390-21unixbench_singl19:44:190
528734992621,4cyclictest528609-21kworker/u8:3+flush-8:019:34:250
528734992621,3cyclictest628978-21kthreadcore20:49:140
528734992621,3cyclictest610465-21kworker/u8:2+flush-8:022:09:170
528734992621,3cyclictest585291-21cron20:05:000
528734992620,5cyclictest486698-21kworker/u8:1+flush-8:019:59:060
528734992620,4cyclictest789691-21cpuspeed_turbos23:34:040
528734992618,6cyclictest684489-21latency_hist21:45:000
528734992617,7cyclictest649170-21ntpq21:09:160
528734992613,9cyclictest650060-21sshd21:10:260
528744992521,3cyclictest541174-21aten2_r5power_p19:24:042
528744992520,3cyclictest789697-21cpuspeed_turbos23:34:032
528744992519,4cyclictest540509-21sendmail19:20:002
528736992519,4cyclictest843381-21systemd-run00:25:011
528736992519,4cyclictest839-21mta-sts-daemon19:54:041
528736992518,5cyclictest634980-21latency_hist20:55:001
528736992517,6cyclictest669603-21cron21:30:001
528734992521,2cyclictest699305-21cron22:00:000
528734992519,4cyclictest545321-21unixbench_multi19:24:210
528734992519,4cyclictest539903-21ntp_kernel_pll_19:19:150
528734992517,6cyclictest833461-21cron00:15:000
528734992515,8cyclictest803149-21ntpq23:44:130
52873499251,19cyclictest533689-21kworker/0:2+events23:35:470
528744992420,3cyclictest610465-21kworker/u8:2+events_unbound21:14:102
528744992420,3cyclictest571211-21cpuspeed_turbos19:54:032
528744992418,4cyclictest609998-21apt-get20:30:002
528736992420,2cyclictest0-21swapper/120:34:001
528736992420,2cyclictest0-21swapper/120:04:191
528736992419,3cyclictest853244-21cron00:35:001
528736992419,3cyclictest621449-21irqrtprio20:44:101
528736992419,3cyclictest543598-21kthreadcore19:24:111
528736992417,5cyclictest660302-21apt-get21:24:021
528736992417,5cyclictest278-21systemd-journal21:07:271
52873499245,18cyclictest533689-21kworker/0:2+events21:45:510
52873499245,18cyclictest533689-21kworker/0:2+events21:45:510
52873499244,18cyclictest799337-21kworker/0:1+events00:08:550
528734992420,2cyclictest662462-21kthreadcore21:24:100
528734992420,2cyclictest0-21swapper/020:29:040
528734992418,4cyclictest848185-21unixbench_singl00:29:220
528734992418,4cyclictest740083-21cut22:44:050
528734992415,7cyclictest591038-21fschecks_count20:14:060
52874499232,20cyclictest0-21swapper/222:24:182
528744992319,2cyclictest749954-21aten2_r5power_e22:54:022
528744992319,2cyclictest594987-21unixbench_multi20:14:212
528744992316,5cyclictest845-21mta-sts-daemon19:30:002
528736992319,2cyclictest0-21swapper/123:44:091
528736992319,2cyclictest0-21swapper/120:19:141
528736992319,2cyclictest0-21swapper/120:14:081
528736992319,2cyclictest0-21swapper/100:00:001
528736992319,2cyclictest0-21swapper/100:00:001
528736992314,6cyclictest278-21systemd-journal21:10:261
528734992317,4cyclictest813578-21unixbench_singl23:54:210
528734992317,4cyclictest813578-21unixbench_singl23:54:210
528734992317,4cyclictest760077-21fschecks_count23:04:060
52873499231,21cyclictest533689-21kworker/0:2+events20:43:150
528744992219,2cyclictest804395-21aten2_r5power_c23:49:022
528744992219,2cyclictest580969-21aten2_r5power_p20:04:042
528744992217,3cyclictest705146-21fschecks_count22:09:062
528736992218,2cyclictest0-21swapper/122:24:161
528736992218,2cyclictest0-21swapper/122:19:181
528736992218,2cyclictest0-21swapper/120:39:081
528736992218,2cyclictest0-21swapper/100:19:121
528736992217,3cyclictest0-21swapper/121:39:061
528736992217,3cyclictest0-21swapper/120:29:031
528736992216,4cyclictest810218-21kthreadcore23:54:101
528736992216,4cyclictest810218-21kthreadcore23:54:101
528734992217,4cyclictest712075-21kthreadcore22:14:110
528734992216,4cyclictest586178-21fschecks_time20:09:070
528734992212,7cyclictest630795-21grep20:54:040
52874499212,13cyclictest664074-21ntpq21:24:152
528744992118,2cyclictest620815-21aten2_r5power_p20:44:052
528744992118,2cyclictest0-21swapper/222:50:002
528744992113,6cyclictest858154-21cron00:40:002
52873699212,5cyclictest798241-21ntpq23:39:161
528736992117,2cyclictest0-21swapper/123:34:141
528736992117,2cyclictest0-21swapper/121:49:041
528736992117,2cyclictest0-21swapper/121:49:031
528736992115,4cyclictest847006-21kthreadcore00:29:121
528744992017,2cyclictest0-21swapper/221:00:012
528744992015,3cyclictest844142-21cpuspeed_turbos00:29:052
528744992015,3cyclictest0-21swapper/222:19:202
528736992015,3cyclictest0-21swapper/123:09:111
528736992011,7cyclictest824491-21tune2fs00:09:061
528734992014,4cyclictest764981-21cpuspeed_turbos23:09:040
5239802203,10sleep30-21swapper/319:06:093
52874499199,8cyclictest588384-21tr20:09:122
52874499192,12cyclictest763592-21ntpq23:04:162
528744991916,2cyclictest0-21swapper/221:10:002
528744991915,3cyclictest773966-21unixbench_singl23:14:202
528744991915,2cyclictest695165-21cpuspeed_turbos21:59:042
528744991915,2cyclictest551411-21cpuspeed_turbos19:34:042
528744991911,6cyclictest831759-21tr00:14:112
528744991911,6cyclictest734357-21sed22:35:012
528744991910,7cyclictest278-21systemd-journal00:25:002
52874499188,2cyclictest0-21swapper/223:24:132
52874499183,3cyclictest8120411kthreadcore23:54:112
52874499183,3cyclictest8120411kthreadcore23:54:112
528744991815,2cyclictest615992-21cpuspeed_turbos20:39:062
528744991814,2cyclictest0-21swapper/223:44:042
528744991814,2cyclictest0-21swapper/200:09:212
528744991813,4cyclictest765465-21tr23:09:092
528744991813,3cyclictest724840-21tr22:29:032
528736991811,5cyclictest837-21mta-sts-daemon22:03:331
528734991813,2cyclictest0-21swapper/019:10:010
52874499179,6cyclictest816210-21cut23:59:092
52874499179,6cyclictest816210-21cut23:59:092
52874499179,6cyclictest613778-21tr20:34:102
52874499177,7cyclictest822263-21tr00:04:092
52874499174,10cyclictest687650-21kthreadcore21:49:102
52874499174,10cyclictest687650-21kthreadcore21:49:102
528744991714,2cyclictest684340-21unixbench_multi21:44:202
528744991713,2cyclictest784567-21aten2_r5power_c23:29:062
528744991713,2cyclictest0-21swapper/223:20:012
528744991712,4cyclictest743996-21tail22:44:212
528744991712,3cyclictest644438-21find21:04:172
528744991712,3cyclictest0-21swapper/222:39:132
528744991711,4cyclictest0-21swapper/220:19:122
528744991711,4cyclictest0-21swapper/219:14:112
528744991710,5cyclictest0-21swapper/220:54:112
7250912162,8sleep30-21swapper/322:29:083
52874499167,7cyclictest666470-21cut21:29:092
52874499167,2cyclictest0-21swapper/219:49:582
52874499162,13cyclictest0-21swapper/222:14:092
528744991610,4cyclictest0-21swapper/219:59:082
52874499160,6cyclictest604696-21chrt20:24:202
7110922155,6sleep30-21swapper/322:14:113
52874499157,6cyclictest561882-21sed19:44:072
52874499157,6cyclictest561882-21sed19:44:072
528744991510,3cyclictest0-21swapper/221:40:002
528744991510,3cyclictest0-21swapper/200:34:062
8482842142,6sleep30-21swapper/300:30:023
7458332140,5sleep30-21swapper/322:49:093
7333882142,8sleep30-21swapper/322:34:133
8236892132,6sleep30-21swapper/300:05:013
7839602132,6sleep30-21swapper/323:25:013
7699842132,7sleep30-21swapper/323:14:053
7441352132,6sleep30-21swapper/322:45:003
7350642133,6sleep30-21swapper/322:39:073
6660672133,7sleep30-21swapper/321:29:103
6300522132,6sleep30-21swapper/320:50:013
5767992132,7sleep30-21swapper/319:59:093
5566012132,7sleep30-21swapper/319:39:073
8427532122,6sleep30-21swapper/300:24:153
8140062122,6sleep30-21swapper/323:56:263
8140062122,6sleep30-21swapper/323:56:263
8084412122,6sleep30-21swapper/323:49:203
8032992122,6sleep30-21swapper/323:44:193
7980062122,6sleep30-21swapper/323:39:133
7592972122,6sleep30-21swapper/323:00:013
7555532122,6sleep30-21swapper/322:59:093
7539112122,6sleep30-21swapper/322:54:193
7184052122,6sleep30-21swapper/322:19:133
6948692122,6sleep30-21swapper/321:58:263
6899322122,6sleep30-21swapper/321:54:023
6848222122,6sleep30-21swapper/321:46:263
6848222122,6sleep30-21swapper/321:46:263
6715062122,6sleep30-21swapper/321:34:113
6420652122,6sleep30-21swapper/321:04:093
6353092122,6sleep30-21swapper/320:56:273
6259292122,6sleep30-21swapper/320:49:093
6250072122,6sleep30-21swapper/320:44:233
6050922122,6sleep30-21swapper/320:25:013
6009282122,6sleep30-21swapper/320:24:053
5956412122,6sleep30-21swapper/320:18:273
5655042122,5sleep30-21swapper/319:45:013
5554662122,6sleep30-21swapper/319:34:223
5345182123,6sleep30-21swapper/319:15:043
8535312112,5sleep30-21swapper/300:35:433
8486612112,6sleep30-21swapper/300:31:493
8338382112,5sleep30-21swapper/300:16:533
8291202112,5sleep30-21swapper/300:14:043
8235782112,6sleep30-21swapper/300:04:533
8090382112,6sleep30-21swapper/323:51:013
8090382112,6sleep30-21swapper/323:51:013
7891622112,6sleep30-21swapper/323:30:263
7842882112,6sleep30-21swapper/323:26:133
7745852112,6sleep30-21swapper/323:18:553
7644222112,6sleep30-21swapper/323:05:113
7193782113,5sleep30-21swapper/322:20:093
7046342112,6sleep30-21swapper/322:06:293
6799612112,6sleep30-21swapper/321:42:423
6755562112,5sleep30-21swapper/321:39:083
6600992112,6sleep30-21swapper/321:21:433
6506102112,5sleep30-21swapper/321:14:053
6453962112,5sleep30-21swapper/321:08:433
6154932114,5sleep30-21swapper/320:35:453
6104582112,6sleep30-21swapper/320:30:033
5905522112,6sleep30-21swapper/320:11:293
5808842112,6sleep30-21swapper/320:04:033
5457422112,6sleep30-21swapper/319:25:433
5413992112,6sleep30-21swapper/319:24:073
5288972112,6sleep30-21swapper/319:10:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional