You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 02:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Dec 20, 2025 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
74195322360,2sleep3481ktimers/322:04:103
74195322360,2sleep3481ktimers/322:04:103
6670042540,5sleep0201rcuc/020:49:040
566751995343,7cyclictest732586-21latency_hist21:55:011
7635962520,1sleep0763599-21sed22:29:030
566751995245,5cyclictest757497-21kworker/u8:2+flush-8:022:39:081
566755995143,6cyclictest278-21systemd-journal00:15:002
566751995145,4cyclictest782113-21kworker/u8:3+flush-8:023:24:131
566751995145,4cyclictest782113-21kworker/u8:3+flush-8:023:24:131
566751995143,6cyclictest278-21systemd-journal21:20:011
566747994939,7cyclictest663130-21latency_hist20:45:000
5897202470,2sleep0201rcuc/019:34:010
5897202470,2sleep0201rcuc/019:34:010
566751994537,6cyclictest841367-21kworker/u8:0+flush-8:000:14:131
566751994337,5cyclictest841367-21kworker/u8:0+flush-8:023:49:021
566751994336,5cyclictest638324-21kworker/u8:3+flush-8:020:59:091
566751994335,6cyclictest278-21systemd-journal22:50:001
566747994332,8cyclictest599482-21diskstats19:43:580
566751994234,6cyclictest851769-21apt-get23:58:071
7727442410,3sleep013-21ksoftirqd/022:38:580
566751994133,6cyclictest727587-21kworker/u8:0+flush-8:022:44:131
566747994130,8cyclictest628221-21latency_hist20:10:010
566751994034,5cyclictest638324-21kworker/u8:3+flush-8:021:34:091
566751994034,4cyclictest875948-21kworker/u8:3+events_unbound00:39:021
566751994027,10cyclictest603600-21awk19:45:001
566747994035,4cyclictest851821-21kworker/u8:1+flush-8:000:24:130
566747993931,5cyclictest841423-21latency_hist23:45:010
566751993833,3cyclictest806627-21kworker/u8:2+flush-8:023:34:051
566751993831,5cyclictest791949-21kworker/u8:0+flush-8:023:19:021
566751993830,6cyclictest584170-21/usr/sbin/munin19:29:061
56674799388,15cyclictest708082-21latency_hist21:30:010
56674799387,8cyclictest653263-21awk20:35:010
566751993731,4cyclictest3919783-21kworker/u8:2+flush-8:019:20:001
56674799378,16cyclictest574301-21aten2_r5power_c19:18:580
566751993630,5cyclictest782113-21kworker/u8:3+flush-8:022:53:581
566751993630,5cyclictest638324-21kworker/u8:3+flush-8:022:04:121
566751993630,5cyclictest638324-21kworker/u8:3+flush-8:022:04:121
566751993630,4cyclictest851821-21kworker/u8:1+flush-8:000:24:141
566751993626,8cyclictest598435-21apt-get19:40:011
566751993626,8cyclictest598435-21apt-get19:40:001
566747993617,9cyclictest736936-21ntpq21:59:080
566747993613,13cyclictest807914-21/usr/sbin/munin23:14:010
566747993612,11cyclictest697478-21/usr/sbin/munin21:19:100
5659162364,24sleep1565948-21ntpq19:09:071
566751993529,5cyclictest782113-21kworker/u8:3+flush-8:000:09:131
566751993527,6cyclictest583010-21ntpq19:24:061
56674799359,11cyclictest702376-21ntpq21:24:060
56674799358,15cyclictest781878-21idleruntime-cro22:45:000
56674799358,13cyclictest826829-21latency_hist23:30:000
56674799357,16cyclictest856503-21latency_hist00:00:010
56674799356,5cyclictest618389-21munin-run20:00:000
56674799356,14cyclictest827407-21df_inode23:33:580
56674799354,17cyclictest0-21swapper/019:48:560
566747993512,11cyclictest835970-21/usr/sbin/munin23:39:110
566747993512,11cyclictest684348-21/usr/sbin/munin21:09:010
566747993510,9cyclictest576-21runrttasks00:18:550
566751993430,3cyclictest638324-21kworker/u8:3+flush-8:021:59:141
56674799349,15cyclictest717219-21ntp_states21:39:100
56674799349,12cyclictest856950-21aten2_r5power_p00:03:580
56674799349,10cyclictest761603-21ntpq22:24:090
56674799348,13cyclictest732114-21/usr/sbin/munin21:54:120
56674799348,12cyclictest805849-21/usr/sbin/munin23:09:040
56674799347,16cyclictest623317-21latency_hist20:05:010
56674799346,8cyclictest887026-21/usr/sbin/munin00:34:040
56674799346,8cyclictest887026-21/usr/sbin/munin00:34:040
56674799346,18cyclictest683006-21/usr/sbin/munin21:04:140
56674799346,16cyclictest816013-21wc23:19:080
56674799346,16cyclictest639082-21/usr/sbin/munin20:24:010
56674799344,18cyclictest0-21swapper/022:33:550
566747993413,4cyclictest708531-21apt-get21:33:560
566747993412,12cyclictest692295-21/usr/sbin/munin21:14:050
566747993411,9cyclictest579597-21sort19:23:580
566747993411,13cyclictest885516-21python300:29:130
566747993411,11cyclictest895173-21ntpq00:39:090
566747993411,10cyclictest741834-21ntpq22:04:070
566747993411,10cyclictest741834-21ntpq22:04:070
566747993410,9cyclictest801571-21cron23:05:000
566747993410,13cyclictest677545-21ntpq20:59:100
566747993410,13cyclictest587959-21ntpq19:29:080
566747993410,11cyclictest782942-21/usr/sbin/munin22:49:010
566755993328,4cyclictest782113-21kworker/u8:3+flush-8:000:04:162
566755993327,4cyclictest638324-21kworker/u8:3+flush-8:020:24:002
566755993325,6cyclictest278-21systemd-journal22:05:002
566755993325,6cyclictest278-21systemd-journal22:05:002
56674799339,6cyclictest792273-21apt-get22:58:580
56674799339,14cyclictest746730-21ntpq22:09:060
56674799338,15cyclictest866176-21munin-run00:10:000
56674799338,15cyclictest748155-21df_inode22:13:590
56674799338,15cyclictest718869-21/usr/sbin/munin21:44:000
56674799337,17cyclictest842691-21/usr/sbin/munin23:49:030
56674799337,16cyclictest672594-21ntpq20:54:070
56674799337,12cyclictest653627-21apt-get20:38:560
566747993323,8cyclictest612862-21ntpq19:54:080
566747993313,12cyclictest0-21swapper/019:35:490
566747993313,12cyclictest0-21swapper/019:35:490
566747993313,10cyclictest727012-21ntpq21:49:070
566747993312,10cyclictest0-21swapper/022:53:420
566747993311,9cyclictest628770-21apt-get20:13:550
566747993311,11cyclictest647386-21ntpq20:29:090
566747993310,14cyclictest866739-21/usr/sbin/munin00:13:560
566751993228,3cyclictest791949-21kworker/u8:0+events_unbound23:09:101
566751993227,4cyclictest638324-21kworker/u8:3+flush-8:020:39:001
56674799326,6cyclictest635862-21kthreadcore20:19:050
566747993211,6cyclictest0-21swapper/019:13:540
566747993210,10cyclictest821179-21ntpq23:24:100
566747993210,10cyclictest821179-21ntpq23:24:100
566751993127,3cyclictest571920-21kworker/u8:0+events_unbound19:58:581
566751993126,4cyclictest742477-21kworker/u8:1+flush-8:022:34:131
566751993125,5cyclictest608746-21kworker/u8:2+flush-8:021:14:081
566751993124,6cyclictest571920-21kworker/u8:0+flush-8:020:19:151
56674799317,11cyclictest850239-21kthreadcore23:54:030
56674799316,11cyclictest754032-21kthreadcore22:19:030
5665012313,9sleep20-21swapper/219:09:292
566751993027,2cyclictest727666-21systemd-run21:50:001
566751993027,2cyclictest669543-21irqrtprio20:54:001
566751993024,5cyclictest791949-21kworker/u8:0+flush-8:023:29:101
566751993023,5cyclictest638324-21kworker/u8:3+flush-8:021:24:081
7929732290,4sleep3575-21kworker/3:2-events22:59:033
566755992923,4cyclictest891375-21apt-get00:38:542
566751992925,3cyclictest757497-21kworker/u8:2+events_unbound22:29:001
566751992924,4cyclictest851821-21kworker/u8:1+events_unbound00:18:571
566751992924,4cyclictest638324-21kworker/u8:3+flush-8:022:18:591
566751992922,6cyclictest673472-21kworker/u8:0+flush-8:021:09:151
566755992820,6cyclictest278-21systemd-journal22:30:012
566751992824,3cyclictest3930591-21kworker/u8:1+events_unbound19:34:111
566751992824,3cyclictest3930591-21kworker/u8:1+events_unbound19:34:111
566751992823,4cyclictest633154-21kworker/u8:1+flush-8:020:29:091
566751992823,4cyclictest571920-21kworker/u8:0+flush-8:019:50:111
566751992823,3cyclictest679669-21irqrtprio21:04:021
566751992822,5cyclictest3930591-21kworker/u8:1+flush-8:019:49:101
5631172282,8sleep0563941-21kthreadcore19:09:020
566755992724,2cyclictest747246-21unixbench_singl22:09:122
566755992721,4cyclictest608746-21kworker/u8:2+flush-8:021:10:052
566751992721,5cyclictest782113-21kworker/u8:3+events_unbound23:03:561
566751992721,5cyclictest727587-21kworker/u8:0+events_unbound22:14:111
566751992721,4cyclictest658765-21apt-get20:43:521
566755992623,2cyclictest648578-21aten2_r5power_p20:33:582
566755992622,2cyclictest807523-21aten2_r5power_c23:13:572
566755992621,3cyclictest753361-21irqcore22:19:022
566751992623,2cyclictest571822-21latency_hist19:15:001
566751992622,2cyclictest847456-21irqcore23:54:001
566751992621,4cyclictest791949-21kworker/u8:0+events_unbound23:10:531
566751992620,3cyclictest782113-21kworker/u8:3+events_unbound23:39:111
566755992521,2cyclictest757998-21cpuspeed_turbos22:23:552
566755992521,2cyclictest574340-21aten2_r5power_e19:18:582
566755992517,6cyclictest278-21systemd-journal23:09:082
566751992517,6cyclictest886441-21apt-get00:33:571
566751992517,6cyclictest886441-21apt-get00:33:571
566755992420,2cyclictest693996-21fschecks_time21:19:002
566755992420,2cyclictest0-21swapper/223:05:002
566755992420,2cyclictest0-21swapper/200:00:002
566751992420,3cyclictest727587-21kworker/u8:0+events_unbound22:24:101
566751992419,4cyclictest638324-21kworker/u8:3+flush-8:021:35:311
566751992419,4cyclictest633154-21kworker/u8:1+flush-8:020:24:551
566751992419,3cyclictest638324-21kworker/u8:3+flush-8:022:09:011
566755992320,2cyclictest723603-21fschecks_time21:48:592
566755992319,2cyclictest584414-21cpuspeed_turbos19:28:572
566755992314,7cyclictest658432-21cp20:40:012
566751992319,2cyclictest0-21swapper/123:00:001
566751992318,4cyclictest851821-21kworker/u8:1+flush-8:000:25:301
56675599229,3cyclictest8820342sed00:29:022
566755992219,2cyclictest767898-21fschecks_count22:33:592
566755992219,2cyclictest614076-21aten2_r5power_e19:58:572
566755992218,2cyclictest733400-21fschecks_count21:58:582
566751992219,2cyclictest624451-21irqcore20:09:031
566751992219,2cyclictest622611-21needreboot20:04:061
566751992218,3cyclictest638324-21kworker/u8:3+events_unbound21:25:341
566751992218,2cyclictest0-21swapper/121:44:111
566751992217,4cyclictest571920-21kworker/u8:0+flush-8:020:10:051
566751992216,4cyclictest633154-21kworker/u8:1+flush-8:020:34:031
566751992212,8cyclictest278-21systemd-journal20:48:081
566755992118,2cyclictest787633-21fschecks_count22:53:572
566755992118,2cyclictest633721-21aten2_r5power_c20:18:582
566755992118,2cyclictest0-21swapper/221:00:002
566751992117,2cyclictest0-21swapper/100:04:041
566751992116,4cyclictest841285-21sed23:44:151
8575972200,3sleep3575-21kworker/3:2+events00:04:033
566755992017,2cyclictest772857-21fschecks_count22:38:592
566755992017,2cyclictest0-21swapper/221:35:002
566755992016,3cyclictest608746-21kworker/u8:2+flush-8:021:09:052
566755992016,2cyclictest782467-21aten2_r5power_c22:48:562
566755992016,2cyclictest0-21swapper/220:55:002
566755992014,5cyclictest0-21swapper/223:39:122
8443222190,5chrt0-21swapper/223:49:052
56675599192,12cyclictest777522-21apt-get22:43:552
56675599192,12cyclictest589110-21apt-get19:33:542
56675599192,12cyclictest589110-21apt-get19:33:542
566755991915,2cyclictest0-21swapper/219:54:132
566755991915,2cyclictest0-21swapper/219:24:082
566755991914,4cyclictest0-21swapper/223:20:002
5627472192,9sleep30-21swapper/319:09:013
566755991815,2cyclictest703681-21aten2_r5power_p21:28:572
566755991814,2cyclictest0-21swapper/223:00:002
566755991814,2cyclictest0-21swapper/222:14:082
566755991814,2cyclictest0-21swapper/220:39:072
566755991814,2cyclictest0-21swapper/220:29:082
566755991813,4cyclictest717777-21idleruntime-cro21:40:002
566755991813,4cyclictest0-21swapper/221:54:142
56675599179,6cyclictest630524-21tr20:14:032
56675599177,8cyclictest664498-21sed20:49:012
56675599175,8cyclictest618948-21apt-get20:03:552
566755991714,2cyclictest679299-21fschecks_time21:04:002
566755991713,2cyclictest603587-21cron19:45:002
566755991713,2cyclictest0-21swapper/223:54:052
566755991713,2cyclictest0-21swapper/223:34:032
566755991713,2cyclictest0-21swapper/219:40:002
566755991713,2cyclictest0-21swapper/219:40:002
566755991712,4cyclictest826454-21unixbench_multi23:29:152
566755991712,3cyclictest0-21swapper/220:09:022
566755991711,4cyclictest0-21swapper/200:24:052
56675599171,12cyclictest718351-21apt-get21:43:542
566755991710,5cyclictest278-21systemd-journal00:10:002
6140202162,9sleep30-21swapper/319:58:583
56675599168,6cyclictest817351-21hostname23:23:562
56675599168,6cyclictest817351-21hostname23:23:562
56675599162,13cyclictest0-21swapper/200:19:092
566755991613,2cyclictest0-21swapper/221:23:532
566755991612,2cyclictest0-21swapper/223:44:102
56675599160,14cyclictest608506-21ls19:50:002
6060682155,6sleep30-21swapper/319:49:063
8913492142,8sleep30-21swapper/300:38:553
8666952142,8sleep30-21swapper/300:13:553
56675599147,5cyclictest886197-21sshd00:31:072
56675599147,5cyclictest886197-21sshd00:31:072
6292402132,7sleep30-21swapper/320:14:013
5879012132,7sleep30-21swapper/319:29:083
5786432132,6sleep30-21swapper/319:20:013
566755991310,2cyclictest0-21swapper/219:14:082
8901002122,6sleep30-21swapper/300:34:103
8901002122,6sleep30-21swapper/300:34:093
8812932122,6sleep30-21swapper/300:26:313
8787232122,6sleep30-21swapper/300:24:063
8753832122,6sleep30-21swapper/300:19:093
8470232122,6sleep30-21swapper/323:53:573
8457982122,6sleep30-21swapper/323:49:113
8276832122,6sleep30-21swapper/323:34:033
8118932122,6sleep30-21swapper/323:15:013
7885042122,6sleep30-21swapper/322:54:023
7824412122,6sleep30-21swapper/322:48:573
7580412122,6sleep30-21swapper/322:23:573
7473862122,6sleep30-21swapper/322:10:013
7429722122,6sleep30-21swapper/322:08:533
7320632123,6sleep30-21swapper/321:54:123
7227612122,6sleep30-21swapper/321:45:013
7023932122,6sleep30-21swapper/321:24:073
6940562122,6sleep30-21swapper/321:19:023
6737062123,5sleep30-21swapper/320:58:313
6581442122,6sleep30-21swapper/320:40:013
6575022122,6sleep30-21swapper/320:39:133
6430392122,5sleep30-21swapper/320:25:013
6363342122,6sleep30-21swapper/320:19:073
5936972122,6sleep30-21swapper/319:35:013
5936972122,6sleep30-21swapper/319:35:013
5890252122,6sleep30-21swapper/319:33:103
5890252122,6sleep30-21swapper/319:33:093
5678222122,6sleep30-21swapper/319:13:593
8615312112,6sleep30-21swapper/300:05:563
8512872112,5sleep30-21swapper/323:55:013
8368632113,5sleep30-21swapper/323:41:453
8318432112,6sleep30-21swapper/323:35:363
8220902112,6sleep30-21swapper/323:26:523
8170512112,6sleep30-21swapper/323:20:323
8170512112,6sleep30-21swapper/323:20:313
8071702112,5sleep30-21swapper/323:10:073
8022662112,6sleep30-21swapper/323:07:553
7969032112,5sleep30-21swapper/323:00:083
7773692112,6sleep30-21swapper/322:42:153
7753012112,5sleep30-21swapper/322:39:063
7673512112,6sleep30-21swapper/322:30:353
7662882112,5sleep30-21swapper/322:29:073
7527262112,6sleep30-21swapper/322:17:553
7182112112,6sleep30-21swapper/321:42:243
7132132112,6sleep30-21swapper/321:36:153
7083712112,6sleep30-21swapper/321:32:093
7039362112,5sleep30-21swapper/321:29:003
6885672112,6sleep30-21swapper/321:11:233
6871742112,5sleep30-21swapper/321:09:063
6788842112,5sleep30-21swapper/321:03:243
6690722112,6sleep30-21swapper/320:53:583
6635892112,5sleep30-21swapper/320:45:033
6482802112,5sleep30-21swapper/320:31:313
6398652112,5sleep30-21swapper/320:24:043
6235892112,6sleep30-21swapper/320:05:433
6186642112,6sleep30-21swapper/320:00:333
6088782112,6sleep30-21swapper/319:51:553
5996102112,5sleep30-21swapper/319:44:013
5742502112,6sleep30-21swapper/319:18:523
7328152102,5sleep30-21swapper/321:55:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional