You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 13:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Thu Dec 18, 2025 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9364991016,74cyclictest0-21swapper/021:30:160
1163421000,2sleep30-21swapper/323:45:133
1163421000,2sleep30-21swapper/323:45:133
936499872,59cyclictest0-21swapper/019:10:060
234072730,2sleep30-21swapper/322:45:323
84792700,2sleep10-21swapper/122:05:251
9365996627,26cyclictest22316-21/usr/sbin/munin22:45:291
9365996626,20cyclictest31369-21/usr/sbin/munin21:40:161
936499652,31cyclictest0-21swapper/022:10:170
936499642,30cyclictest7779-21aten_rbpower_cu20:35:190
936499641,48cyclictest8040-1kworker/0:1H20:50:240
936599633,11cyclictest7950irq/56-dwc_otg_00:05:171
9365996324,18cyclictest19276-21cat21:05:281
9365996227,17cyclictest29464-21df20:05:201
9365996227,17cyclictest29464-21df20:05:201
9365996135,20cyclictest0-21swapper/119:10:061
9365996123,13cyclictest10654-21wc22:10:301
9364996145,6cyclictest7750irq/56-dwc_otg22:25:320
9365996023,13cyclictest11492-21/usr/sbin/munin22:15:281
9365996022,12cyclictest21411-21taskset19:40:361
9365996021,19cyclictest11183-21/usr/sbin/munin19:15:291
9364996036,7cyclictest19170-21fschecks_time00:05:230
936499601,45cyclictest7654-21latency_hist22:05:040
9365995928,19cyclictest25102-21gzip00:20:281
936499594,35cyclictest28891-21unixbench_singl23:00:330
9364995922,21cyclictest31264-21latency_hist21:40:040
9364995840,5cyclictest16359-21unixbench_multi23:55:320
9364995827,13cyclictest7750irq/56-dwc_otg20:15:310
936499581,33cyclictest23989-21apt-config21:20:050
9366995716,7cyclictest7850irq/56-dwc_otg_22:00:172
9365995728,21cyclictest22692-21/usr/sbin/munin00:15:201
9365995720,13cyclictest7750irq/56-dwc_otg19:35:211
9365995717,17cyclictest6171-21fschecks_count20:30:201
9364995732,14cyclictest20332-21grep19:40:180
9364995727,13cyclictest7750irq/56-dwc_otg23:50:040
9364995727,13cyclictest7750irq/56-dwc_otg23:50:040
936499572,30cyclictest0-21swapper/020:45:310
936499571,47cyclictest29066-21latency_hist20:05:040
91452574,15sleep09126-21ls19:10:050
9365995620,9cyclictest16814-21munin-run00:00:031
9364995614,30cyclictest5481-21/usr/sbin/munin23:25:310
9365995523,9cyclictest2846-21diskstats23:20:221
9365995518,14cyclictest24120-21/usr/sbin/munin22:50:311
9365995517,22cyclictest7950irq/56-dwc_otg_21:35:191
9364995525,13cyclictest7750irq/56-dwc_otg23:40:160
936499552,16cyclictest7750irq/56-dwc_otg22:35:180
9365995418,10cyclictest0-21swapper/123:05:051
9364995438,6cyclictest31410-21aten_rbpower_en23:10:150
9364995331,7cyclictest7750irq/56-dwc_otg23:25:030
9364995331,4cyclictest11564-21grep22:15:170
9364995328,3cyclictest0-21swapper/023:35:220
9364995325,7cyclictest7850irq/56-dwc_otg_00:40:030
9364995325,7cyclictest7850irq/56-dwc_otg_00:40:030
936499532,40cyclictest16712-21wc21:00:040
936499532,39cyclictest0-21swapper/000:10:170
936499531,30cyclictest9060-21grep22:05:330
936499531,15cyclictest0-21swapper/023:10:040
936499531,15cyclictest0-21swapper/023:10:040
936499530,43cyclictest23708-21kworker/0:222:50:170
936499530,31cyclictest22108-21wget19:45:170
9365995222,17cyclictest3755-21seq21:51:281
9365995221,13cyclictest31431-21sed00:40:041
9365995221,13cyclictest31431-21sed00:40:041
9365995219,15cyclictest8551-21/usr/sbin/munin20:35:301
9365995218,17cyclictest7950irq/56-dwc_otg_22:40:181
9365995218,15cyclictest7750irq/56-dwc_otg20:27:421
9365995215,12cyclictest1124-21snmpd22:56:151
936499522,24cyclictest0-21swapper/019:50:150
9364995215,28cyclictest1430-21ps21:45:280
936499521,28cyclictest29471-21idleruntime-cro00:35:040
9365995119,20cyclictest13853-21if_eth023:50:211
9365995119,11cyclictest6222-21/usr/sbin/munin23:30:251
9365995119,11cyclictest27447-21apt-get20:00:161
936499516,27cyclictest23205-21switchtime22:45:300
936499515,21cyclictest0-21swapper/021:05:180
9364995131,4cyclictest1125-21runrttasks21:25:290
9364995115,18cyclictest4393-21fschecks_count20:25:210
9365995018,17cyclictest16613-21date21:00:041
9365995017,18cyclictest0-21swapper/120:52:021
9365995016,11cyclictest0-21swapper/119:57:031
936499507,11cyclictest0-21swapper/021:40:300
9364995032,7cyclictest7750irq/56-dwc_otg23:00:040
9364995030,13cyclictest0-21swapper/023:16:190
9364995027,5cyclictest7750irq/56-dwc_otg19:15:280
936499501,25cyclictest2997-21ntpq20:20:260
9365994920,12cyclictest27439-21chrt21:29:471
9365994919,16cyclictest12639-21taskset20:46:371
9365994919,14cyclictest20036-21seq22:37:041
9365994918,16cyclictest14470-21chrt19:24:011
9365994918,12cyclictest807-21aten_rbpower_vo23:15:191
9365994918,12cyclictest0-21swapper/123:12:301
936599491,6cyclictest7950irq/56-dwc_otg_00:30:161
9364994933,5cyclictest7750irq/56-dwc_otg22:30:240
9364994924,8cyclictest7950irq/56-dwc_otg_20:10:040
9364994924,8cyclictest7950irq/56-dwc_otg_20:10:040
936499492,33cyclictest0-21swapper/019:55:310
9364994921,13cyclictest0-21swapper/000:00:290
936499491,6cyclictest6913-21grep23:30:270
936499491,29cyclictest14534-21grep23:50:310
936499491,28cyclictest6183-21fschecks_count20:30:200
936799483,23cyclictest0-21swapper/319:10:073
9365994825,12cyclictest7435-21taskset22:02:231
9365994825,12cyclictest23325-21taskset19:47:001
9365994814,11cyclictest7750irq/56-dwc_otg23:45:161
9365994814,11cyclictest7750irq/56-dwc_otg23:45:161
9364994825,11cyclictest0-21swapper/020:10:220
936499481,9cyclictest25307-21awk21:20:330
936499481,9cyclictest25307-21awk21:20:330
936499481,5cyclictest2749-21grep21:50:190
9364994815,12cyclictest4453-21ls21:55:160
9365994718,16cyclictest7950irq/56-dwc_otg_20:22:121
9365994715,12cyclictest0-21swapper/100:29:031
9365994715,11cyclictest7950irq/56-dwc_otg_23:28:591
936499471,7cyclictest14171-21unixbench_singl19:20:320
936499471,28cyclictest20712-21fschecks_time21:10:200
936799467,24cyclictest0-21swapper/322:55:163
936799467,24cyclictest0-21swapper/322:30:163
936599467,25cyclictest0-21swapper/120:15:181
9365994623,5cyclictest961950wget20:40:181
9365994623,5cyclictest961950wget20:40:181
9365994620,16cyclictest16091-21runrttasks19:26:471
9365994620,16cyclictest16091-21runrttasks19:26:471
9365994619,12cyclictest21617-21chrt21:10:561
9365994615,12cyclictest7750irq/56-dwc_otg23:06:501
9365994615,12cyclictest7750irq/56-dwc_otg23:06:501
9365994615,11cyclictest0-21swapper/119:51:541
936499465,18cyclictest0-21swapper/019:30:230
9364994624,6cyclictest22563-21wget00:15:180
9364994618,15cyclictest0-21swapper/019:35:140
936799457,24cyclictest0-21swapper/300:10:173
936699451,27cyclictest0-21swapper/220:10:052
936699451,27cyclictest0-21swapper/220:10:052
9365994517,16cyclictest0-21swapper/121:45:421
9365994515,17cyclictest1125-21runrttasks21:23:261
9365994515,17cyclictest1125-21runrttasks21:23:261
9365994512,18cyclictest5808-21taskset21:59:421
936499451,23cyclictest24289-21tr00:20:140
936799447,23cyclictest0-21swapper/323:20:093
9365994419,9cyclictest7850irq/56-dwc_otg_20:13:581
9365994416,9cyclictest7750irq/56-dwc_otg23:42:331
9365994415,13cyclictest7750irq/56-dwc_otg00:15:021
9365994414,17cyclictest17953-21seq19:32:261
9364994424,4cyclictest21677-21grep22:40:320
936799437,22cyclictest0-21swapper/320:10:093
936599438,22cyclictest0-21swapper/122:20:171
9365994316,10cyclictest0-21swapper/100:01:321
936499432,18cyclictest0-21swapper/022:25:040
936799421,25cyclictest0-21swapper/320:25:173
936699427,23cyclictest0-21swapper/221:30:162
9365994227,12cyclictest28676-21cat21:30:301
9365994217,12cyclictest7850irq/56-dwc_otg_22:34:281
9365994213,11cyclictest7750irq/56-dwc_otg21:00:121
9365994212,12cyclictest0-21swapper/123:37:001
936499422,32cyclictest0-21swapper/020:45:000
936499422,32cyclictest0-21swapper/020:45:000
9365994116,15cyclictest0-21swapper/121:19:021
9364994121,4cyclictest7750irq/56-dwc_otg19:25:230
9364994121,4cyclictest7750irq/56-dwc_otg19:25:230
936499411,3cyclictest0-21swapper/000:25:300
936799405,23cyclictest3346-21ls20:20:313
936799401,25cyclictest0-21swapper/320:55:163
936699407,23cyclictest0-21swapper/221:35:172
936699404,10cyclictest0-21swapper/221:10:152
936499401,4cyclictest128-21systemd-journal21:00:040
936799397,23cyclictest0-21swapper/323:25:163
936799391,24cyclictest0-21swapper/323:35:183
936699394,11cyclictest7950irq/56-dwc_otg_00:25:182
9365993921,13cyclictest16219-21tail22:25:321
936799381,23cyclictest27042-21timerandwakeup00:25:313
936799381,13cyclictest12471-21sed20:45:313
936799381,13cyclictest0-21swapper/321:15:553
936699389,15cyclictest0-21swapper/220:40:172
936699389,15cyclictest0-21swapper/220:40:172
936699381,23cyclictest26291-21ls22:55:212
111822381,32sleep311196-21apt-get19:15:153
936799377,21cyclictest0-21swapper/322:40:173
9367993715,12cyclictest81072chrt22:05:193
936799371,22cyclictest24373-21uniq21:20:203
936799371,22cyclictest24373-21uniq21:20:203
9366993718,4cyclictest17514-21missed_timers22:30:242
936799366,15cyclictest0-21swapper/322:35:183
936799361,25cyclictest1018-21cut23:15:223
936799361,24cyclictest11765-21cut22:15:203
936699366,22cyclictest7950irq/56-dwc_otg_19:30:152
9367993517,5cyclictest27838-21aten_rbpower_vo23:00:183
936699359,11cyclictest7850irq/56-dwc_otg_22:25:032
936699351,23cyclictest26845-21ls21:25:302
936799347,24cyclictest0-21swapper/321:35:173
936799344,14cyclictest7353-21sed23:30:323
936799342,8cyclictest28146-21ntp_states20:00:293
9367993428,4cyclictest10416-21ls23:40:243
936799341,5cyclictest7950irq/56-dwc_otg_22:10:323
936699349,14cyclictest7950irq/56-dwc_otg_19:40:232
936699342,5cyclictest0-21swapper/221:50:152
9366993420,10cyclictest0-21swapper/219:15:322
936699341,22cyclictest9988-21ls19:10:212
212842340,5sleep3936799cyclictest21:10:293
936799331,25cyclictest31888-21missed_timers21:40:243
936799331,22cyclictest30038-21uniq00:35:223
936799331,22cyclictest30038-21uniq00:35:223
936699337,14cyclictest0-21swapper/221:15:162
936699337,13cyclictest7950irq/56-dwc_otg_00:17:532
936699333,18cyclictest21158-21ls00:10:242
9366993326,4cyclictest16887-21cut21:00:192
936699331,23cyclictest0-21swapper/222:40:172
936699331,22cyclictest0-21swapper/220:17:462
936799326,14cyclictest0-21swapper/321:50:153
936799324,18cyclictest0-21swapper/319:50:173
936799322,20cyclictest0-21swapper/320:15:213
9367993217,4cyclictest6891-21awk22:00:293
936799321,18cyclictest13558-21cut22:20:203
936699326,11cyclictest7950irq/56-dwc_otg_20:15:032
936699326,10cyclictest7850irq/56-dwc_otg_20:20:182
81702320,5sleep38172-21missed_timers19:05:213
936799317,9cyclictest19696-21unixbench_multi21:05:333
936799315,17cyclictest0-21swapper/319:57:273
936799315,10cyclictest7950irq/56-dwc_otg_00:05:223
9367993114,5cyclictest15280-21basename23:55:173
936799311,23cyclictest13735-21fschecks_time23:50:193
936799311,20cyclictest0-21swapper/300:20:163
936699317,5cyclictest7750irq/56-dwc_otg19:55:162
936699315,6cyclictest7850irq/56-dwc_otg_23:05:332
936699315,6cyclictest7850irq/56-dwc_otg_23:05:332
936699315,6cyclictest7850irq/56-dwc_otg_00:00:322
936699314,4cyclictest7750irq/56-dwc_otg19:35:172
936699314,12cyclictest7850irq/56-dwc_otg_20:30:262
936699313,16cyclictest7950irq/56-dwc_otg_23:24:012
936699312,19cyclictest0-21swapper/222:18:342
9366993114,4cyclictest7364-21unixbench_singl23:30:322
9366993113,5cyclictest18759-21cut22:35:182
936699311,15cyclictest25890-21latency_hist00:25:042
9366993110,6cyclictest0-21swapper/200:40:042
9366993110,6cyclictest0-21swapper/200:40:042
87652310,2sleep20-21swapper/223:35:302
936799306,21cyclictest0-21swapper/320:40:173
936799306,21cyclictest0-21swapper/320:40:173
936799306,10cyclictest1777-21unixbench_multi21:45:313
936799302,18cyclictest0-21swapper/320:30:253
936799301,7cyclictest30224-21tr23:05:273
936799301,7cyclictest30224-21tr23:05:273
9367993013,5cyclictest17036-21fschecks_count21:00:223
936799301,19cyclictest0-21swapper/320:10:053
936799301,19cyclictest0-21swapper/320:10:053
936799301,14cyclictest0-21swapper/300:20:043
9367993010,13cyclictest170392chrt00:00:153
936699303,5cyclictest7950irq/56-dwc_otg_20:46:422
936699301,6cyclictest7850irq/56-dwc_otg_23:55:242
9366993010,6cyclictest7750irq/56-dwc_otg19:50:182
936799297,14cyclictest8011-21fschecks_count20:35:223
936799296,14cyclictest0-21swapper/300:30:173
936799295,12cyclictest28153-21if_wlan021:30:223
936799294,5cyclictest7750irq/56-dwc_otg19:45:173
936799294,5cyclictest7750irq/56-dwc_otg19:30:323
936799291,17cyclictest13675-21ntpq19:20:263
9367992911,11cyclictest21797-21basename19:45:033
936699298,5cyclictest7750irq/56-dwc_otg23:55:032
936699296,6cyclictest7850irq/56-dwc_otg_23:15:182
936699296,5cyclictest10103-21sort23:40:192
936699294,12cyclictest7950irq/56-dwc_otg_22:10:172
936699293,4cyclictest7950irq/56-dwc_otg_21:40:292
936699293,3cyclictest7950irq/56-dwc_otg_20:00:162
936699292,4cyclictest7750irq/56-dwc_otg23:10:242
9366992923,4cyclictest28406-21ls00:30:242
9366992922,5cyclictest7928-21aten_rbpower_cu22:05:182
936699292,13cyclictest7850irq/56-dwc_otg_00:05:272
936699291,3cyclictest0-21swapper/223:05:052
9366992911,5cyclictest13763-21missed_timers20:50:252
936699291,14cyclictest7950irq/56-dwc_otg_19:20:312
936799282,7cyclictest0-21swapper/323:14:083
9367992822,4cyclictest14835-21aten_rbpower_cu19:25:173
9367992822,4cyclictest14835-21aten_rbpower_cu19:25:173
936799281,18cyclictest0-21swapper/322:29:543
936799281,17cyclictest381ktimersoftd/322:50:223
936699289,9cyclictest7750irq/56-dwc_otg20:55:182
936699287,12cyclictest7950irq/56-dwc_otg_22:25:242
936699286,9cyclictest7950irq/56-dwc_otg_21:20:282
936699286,9cyclictest7950irq/56-dwc_otg_21:20:282
936699283,11cyclictest0-21swapper/221:58:022
936699282,6cyclictest0-21swapper/223:45:252
936699282,6cyclictest0-21swapper/223:45:252
936699281,4cyclictest7750irq/56-dwc_otg20:25:302
9366992811,5cyclictest23274-21cat22:45:312
936699281,13cyclictest7950irq/56-dwc_otg_21:46:092
90072284,15sleep20-21swapper/219:09:062
936799275,5cyclictest7750irq/56-dwc_otg20:50:233
936799274,13cyclictest4520-21fschecks_count21:55:193
936799273,4cyclictest7950irq/56-dwc_otg_21:25:233
936699276,8cyclictest8010-21fschecks_count20:35:222
936699274,4cyclictest7950irq/56-dwc_otg_21:05:222
936699273,17cyclictest31-21ksoftirqd/222:53:252
936699272,3cyclictest0-21swapper/219:45:212
936699272,16cyclictest0-21swapper/223:27:162
936699271,6cyclictest7850irq/56-dwc_otg_19:25:472
936699271,6cyclictest7850irq/56-dwc_otg_19:25:472
9367992618,6cyclictest18697-21fschecks_time19:35:213
87662265,14sleep10-21swapper/119:05:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional