You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 01:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon May 04, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38301821790,2sleep3471rcuc/312:16:123
72520997355,15cyclictest280-21systemd-journal12:00:010
72522996557,6cyclictest179774-21kworker/u8:0+events_unbound08:56:121
1458182650,3chrt0-21swapper/008:21:060
72522996054,5cyclictest129573-21kworker/u8:3+flush-8:008:31:161
72520996048,8cyclictest280-21systemd-journal10:56:090
72522995849,7cyclictest329346-21cp11:25:011
72522995846,9cyclictest119203-21apt-get07:55:011
72522995749,6cyclictest174627-21kworker/u8:2+flush-8:009:36:111
72522995749,6cyclictest149555-21kworker/u8:2+flush-8:008:26:121
72522995749,5cyclictest179774-21kworker/u8:0+events_unbound09:25:001
865812560,5chrt0-21swapper/107:21:081
72522995648,6cyclictest119668-21kworker/u8:0+flush-8:008:21:141
72522995648,5cyclictest261563-21kworker/u8:0+events_unbound11:06:031
72520995648,6cyclictest280-21systemd-journal07:50:010
72522995550,4cyclictest20123-21kworker/u8:1+events_unbound07:56:141
72520995535,18cyclictest239372-21/usr/sbin/munin09:56:110
72522995448,5cyclictest353409-21kworker/u8:1+flush-8:011:51:171
72522995447,5cyclictest169393-21kworker/u8:0+flush-8:008:46:141
72522995444,8cyclictest280-21systemd-journal11:30:011
3384512540,1sleep375-21kworker/3:1-events11:31:093
72522995346,5cyclictest269212-21kworker/u8:1+flush-8:010:51:141
72522995247,4cyclictest234071-21kworker/u8:1+events_unbound09:56:181
72522995146,4cyclictest353409-21kworker/u8:1+events_unbound12:06:131
72522995045,4cyclictest269212-21kworker/u8:1+events_unbound11:16:121
72522995043,5cyclictest34983-21kworker/u8:0+flush-8:007:11:111
72522995043,5cyclictest228808-21kworker/u8:2+events_unbound10:01:111
72522995042,6cyclictest174627-21kworker/u8:2+flush-8:009:06:121
72520995028,19cyclictest248073-21ntpq10:01:100
72522994944,4cyclictest339066-21kworker/u8:3+events_unbound12:16:051
72522994943,4cyclictest339066-21kworker/u8:3+flush-8:011:46:111
72520994941,5cyclictest294005-21latency_hist10:50:010
72522994844,3cyclictest223786-21kworker/u8:3+flush-8:009:41:141
72522994842,4cyclictest99530-21apt-get07:35:581
72522994842,4cyclictest174627-21kworker/u8:2+events_unbound09:11:031
72520994837,9cyclictest88347-21ntpq07:21:110
72520994826,19cyclictest280-21systemd-journal10:26:090
72522994742,4cyclictest261563-21kworker/u8:0+flush-8:010:26:181
72522994741,5cyclictest274229-21kworker/u8:2+flush-8:010:31:171
72522994741,4cyclictest397931-21kworker/u8:2+events_unbound12:36:181
72522994741,4cyclictest353409-21kworker/u8:1+events_unbound11:56:181
72522994741,4cyclictest228808-21kworker/u8:2+flush-8:009:51:181
72522994740,4cyclictest339066-21kworker/u8:3+events_unbound11:41:061
72522994737,7cyclictest393789-21latency_hist12:30:011
72520994727,17cyclictest298943-21latency_hist10:55:000
72522994641,3cyclictest383639-21kworker/u8:0+events_unbound12:31:001
72522994640,4cyclictest20123-21kworker/u8:1+events_unbound07:16:181
72522994639,5cyclictest269212-21kworker/u8:1+flush-8:010:36:161
72522994636,7cyclictest269212-21kworker/u8:1+flush-8:011:31:111
72520994639,5cyclictest139448-21apt-get08:15:000
72520994629,15cyclictest224492-21/usr/sbin/munin09:41:100
72522994539,4cyclictest174627-21kworker/u8:2+events_unbound09:26:131
72522994538,5cyclictest179774-21kworker/u8:0+flush-8:009:01:121
72522994438,5cyclictest199121-21kworker/u8:1+flush-8:009:16:141
72522994437,5cyclictest228808-21kworker/u8:2+flush-8:010:21:141
72520994435,7cyclictest128463-21ntpq08:01:110
72522994336,6cyclictest83962-21kworker/u8:3+flush-8:007:26:131
72522994336,5cyclictest261563-21kworker/u8:0+flush-8:011:36:171
72522994233,7cyclictest124730-21apt-get08:00:571
72520994236,4cyclictest274229-21kworker/u8:2+events_unbound11:21:100
72520994231,8cyclictest280-21systemd-journal08:49:590
72520994225,15cyclictest143694-21needreboot08:16:110
72520994219,20cyclictest369071-21latency_hist12:05:010
72522994135,4cyclictest234071-21kworker/u8:1+events_unbound10:06:121
72520994137,3cyclictest83962-21kworker/u8:3+flush-8:007:46:170
72520994134,5cyclictest259153-21/usr/sbin/munin10:16:170
72520994119,19cyclictest124394-21latency_hist08:00:000
72525994034,4cyclictest83962-21kworker/u8:3+flush-8:007:41:152
72522994030,7cyclictest134376-21cp08:10:001
72520994023,15cyclictest194767-21apt-get09:10:590
72525993932,5cyclictest339676-21apt-get11:35:582
72522993934,3cyclictest339066-21kworker/u8:3+flush-8:012:11:071
72522993933,4cyclictest383639-21kworker/u8:0+flush-8:012:21:141
72522993932,5cyclictest20123-21kworker/u8:1+flush-8:007:31:131
72522993930,6cyclictest72345-21latency_hist07:10:011
72520993931,6cyclictest77415-21true07:15:010
72520993930,6cyclictest204342-21latency_hist09:20:010
72520993929,8cyclictest133417-21ntpq08:06:110
72520993920,17cyclictest209349-21turbostat.cron09:25:010
72522993833,3cyclictest119668-21kworker/u8:0+events_unbound08:20:001
72522993832,5cyclictest353409-21kworker/u8:1+flush-8:012:01:131
72522993832,5cyclictest119668-21kworker/u8:0+flush-8:008:11:131
72522993831,5cyclictest179774-21kworker/u8:0+flush-8:009:31:131
72522993829,6cyclictest179774-21kworker/u8:0+events_unbound09:46:171
72520993825,9cyclictest288837-21latency_hist10:45:000
72525993732,3cyclictest248986-21kworker/u8:3+events_unbound10:16:152
72522993732,4cyclictest274229-21kworker/u8:2+events_unbound10:41:111
72522993731,4cyclictest269212-21kworker/u8:1+events_unbound11:11:071
72522993731,4cyclictest269212-21kworker/u8:1+events_unbound11:11:071
72520993731,4cyclictest193322-21apt-get09:06:080
72520993719,16cyclictest275016-21irqrtprio10:31:060
72525993626,8cyclictest280-21systemd-journal11:45:012
72522993632,3cyclictest159754-21kworker/u8:1+events_unbound08:51:171
72522993629,6cyclictest269212-21kworker/u8:1+flush-8:010:46:141
72520993627,6cyclictest388832-21latency_hist12:25:010
72522993529,4cyclictest160048-21apt-get08:35:581
72520993518,15cyclictest0-21swapper/010:25:010
72520993517,15cyclictest0-21swapper/010:15:010
72525993430,3cyclictest20123-21kworker/u8:1+flush-8:007:51:182
72525993429,3cyclictest234071-21kworker/u8:1+events_unbound10:11:172
72520993427,5cyclictest149555-21kworker/u8:2+flush-8:008:41:170
72520993425,7cyclictest349561-21/usr/sbin/munin11:46:090
72520993415,16cyclictest0-21swapper/007:26:120
72520993414,18cyclictest323447-21ntpq11:16:110
7252099341,11cyclictest318332-21ntpq11:11:150
7252099341,11cyclictest318332-21ntpq11:11:140
7252099341,10cyclictest249286-21apt-get10:05:590
72525993324,7cyclictest269172-21cat10:25:012
7252099335,6cyclictest0-21swapper/011:30:590
72520993329,2cyclictest373058-21needreboot12:06:090
72520993319,12cyclictest348940-21unixbench_singl11:41:190
72520993318,13cyclictest0-21swapper/008:51:110
72520993317,14cyclictest0-21swapper/007:41:140
72520993317,13cyclictest0-21swapper/008:26:000
72520993315,16cyclictest885-21mta-sts-daemon11:02:260
72520993315,16cyclictest379956-21sed12:16:050
72520993315,15cyclictest0-21swapper/012:26:130
72520993311,5cyclictest1-21systemd12:40:000
72525993224,6cyclictest280-21systemd-journal10:05:002
72520993217,13cyclictest0-21swapper/009:00:000
72520993213,16cyclictest0-21swapper/008:35:590
72525993127,3cyclictest228808-21kworker/u8:2+events_unbound09:41:202
72525993127,3cyclictest20123-21kworker/u8:1+events_unbound07:16:032
72522993127,2cyclictest309059-21cron11:05:001
72520993122,6cyclictest378514-21grep12:11:160
7252099311,9cyclictest234415-21apt-get09:50:590
72520993116,13cyclictest314165-21apt-key11:10:010
72520993114,15cyclictest94753-21cpuspeed_turbos07:31:010
72520993112,17cyclictest0-21swapper/009:26:060
7252099311,11cyclictest589-21runrttasks09:46:140
72525993026,2cyclictest175198-21fschecks_count08:51:032
7252099306,8cyclictest279560-21fschecks_time10:36:020
7252099302,11cyclictest72345-21latency_hist07:10:010
7252099302,10cyclictest583-21snmpd07:36:000
7252099301,9cyclictest155111-21apt-get08:30:590
72520993015,13cyclictest189447-21cron09:04:590
72520993014,14cyclictest223519-21mailstats09:36:150
72520993012,16cyclictest0-21swapper/012:31:070
72525992923,4cyclictest220459-21kthreadcore09:36:062
72525992921,5cyclictest280-21systemd-journal11:05:012
72522992924,4cyclictest83962-21kworker/u8:3+flush-8:007:46:081
7252099299,6cyclictest356937-21tr11:51:080
7252099298,5cyclictest77883-21cat07:15:020
72520992914,13cyclictest218559-21mailstats09:31:160
72520992912,15cyclictest0-21swapper/011:26:060
72525992824,3cyclictest228808-21kworker/u8:2+events_unbound09:51:152
72525992823,3cyclictest359772-21fschecks_count11:56:042
72525992818,8cyclictest139840-21latency_hist08:15:012
72522992824,3cyclictest234071-21kworker/u8:1+flush-8:010:16:031
72522992822,5cyclictest234071-21kworker/u8:1+flush-8:010:11:061
72522992821,5cyclictest169670-21latency_hist08:45:011
1845872280,3sleep2371rcuc/209:00:002
72525992723,3cyclictest269212-21kworker/u8:1+events_unbound11:31:142
7252099277,4cyclictest343279-21/usr/sbin/munin11:36:090
72525992623,2cyclictest299788-21fschecks_count10:56:022
72525992622,3cyclictest323933-21unixbench_multi11:16:182
72525992621,4cyclictest34983-21kworker/u8:0+events_unbound07:11:062
72525992615,8cyclictest289205-21cat10:45:012
7252599260,10cyclictest1549092sed08:30:012
72525992522,2cyclictest269212-21kworker/u8:1+flush-8:011:11:042
72525992522,2cyclictest269212-21kworker/u8:1+flush-8:011:11:032
72525992521,2cyclictest394424-21fschecks_time12:31:032
72525992521,2cyclictest160080-21aten2_r5power_c08:36:002
72525992520,3cyclictest249511-21cpuspeed_turbos10:06:012
72525992519,4cyclictest293619-21unixbench_multi10:46:182
72522992521,2cyclictest104834-21cut07:41:031
72525992421,2cyclictest190003-21cpuspeed_turbos09:06:002
72525992418,4cyclictest280-21systemd-journal09:05:002
72525992416,6cyclictest280-21systemd-journal08:41:082
72522992417,5cyclictest280-21systemd-journal10:55:081
72525992320,2cyclictest389206-21aten2_r5power_e12:26:002
72525992314,6cyclictest280-21systemd-journal07:34:592
72525992313,7cyclictest280-21systemd-journal11:30:012
72525992219,2cyclictest148882-21needreboot08:21:112
72525992218,2cyclictest403676-21cron12:40:002
72525992218,2cyclictest209696-21aten2_r5power_c09:26:002
72525992218,2cyclictest0-21swapper/210:30:002
72525992217,4cyclictest239749-21uniq09:56:032
72525992217,3cyclictest0-21swapper/207:49:592
72525992118,2cyclictest88922-21grep07:21:192
72525992118,2cyclictest329422-21latency_hist11:25:012
72525992117,3cyclictest179774-21kworker/u8:0+events_unbound09:15:042
72525992117,2cyclictest0-21swapper/211:51:012
72525992117,2cyclictest0-21swapper/208:31:152
72525992113,6cyclictest280-21systemd-journal08:20:002
3235152213,4sleep30-21swapper/311:16:143
904862200,7sleep20-21swapper/207:26:062
72525992016,2cyclictest274605-21fschecks_time10:31:032
72525992011,7cyclictest280682-21cut10:36:062
72525992010,7cyclictest306084-21tr11:01:072
7252599200,18cyclictest134334-21munin-run08:10:002
682022204,9sleep20-21swapper/207:06:052
3570992200,2chrt75-21kworker/3:1+events11:51:083
2238792202,5sleep30-21swapper/309:36:223
7252599192,9cyclictest0-21swapper/210:51:012
7252599192,9cyclictest0-21swapper/208:01:082
72525991915,3cyclictest214829-21cpuspeed_turbos09:31:012
72525991915,3cyclictest199121-21kworker/u8:1+events_unbound09:21:222
72525991915,2cyclictest0-21swapper/207:40:002
72525991914,3cyclictest229740-21fschecks_count09:46:022
72525991911,6cyclictest367644-21cut12:01:092
72525991910,7cyclictest384926-21sed12:21:062
72525991910,7cyclictest377806-21cut12:11:082
72525991910,7cyclictest280-21systemd-journal12:10:002
7252599189,7cyclictest382094-21tr12:16:072
7252599183,1cyclictest0-21swapper/208:46:042
72525991814,2cyclictest0-21swapper/211:46:152
72525991814,2cyclictest0-21swapper/209:11:162
72525991812,4cyclictest0-21swapper/207:56:002
721232183,8sleep30-21swapper/307:07:183
3690912142,6sleep30-21swapper/312:05:023
844882132,6sleep30-21swapper/307:20:023
3938092132,6sleep30-21swapper/312:30:023
3648422133,6sleep30-21swapper/312:01:043
3632962132,7sleep30-21swapper/311:56:153
3251482132,7sleep30-21swapper/311:21:073
2095092133,6sleep30-21swapper/309:25:013
1646692131,8sleep30-21swapper/308:40:003
1437212132,7sleep30-21swapper/308:16:123
942112122,5sleep30-21swapper/307:30:023
899372122,6sleep30-21swapper/307:26:043
769942122,6sleep30-21swapper/307:11:203
3890892122,6sleep30-21swapper/312:25:323
3496032122,6sleep30-21swapper/311:45:583
3490332122,6sleep30-21swapper/311:42:103
3396792122,6sleep30-21swapper/311:36:003
3181792122,6sleep30-21swapper/311:11:123
3181792122,6sleep30-21swapper/311:11:123
3134072122,6sleep30-21swapper/311:06:193
3032362122,6sleep30-21swapper/310:56:123
2943462122,6sleep30-21swapper/310:51:023
2897462122,6sleep30-21swapper/310:46:043
2789122122,5sleep30-21swapper/310:35:003
2732912122,6sleep30-21swapper/310:26:183
2684502122,6sleep30-21swapper/310:21:203
2542382122,6sleep30-21swapper/310:11:013
2440542122,5sleep30-21swapper/310:00:023
2437752122,6sleep30-21swapper/309:57:093
2189082122,6sleep30-21swapper/309:31:203
1999742122,6sleep30-21swapper/309:16:033
1935902122,6sleep30-21swapper/309:06:123
1841692122,6sleep30-21swapper/308:56:173
1697552122,5sleep30-21swapper/308:45:023
1687932122,6sleep30-21swapper/308:41:123
1447432122,5sleep30-21swapper/308:20:013
1237912122,6sleep30-21swapper/307:56:183
1004192122,6sleep30-21swapper/307:36:083
790292112,5sleep30-21swapper/307:15:043
3990192112,5sleep30-21swapper/312:35:583
3840912112,5sleep30-21swapper/312:20:013
3743072112,6sleep30-21swapper/312:10:593
3323772112,6sleep30-21swapper/311:26:093
3040972112,5sleep30-21swapper/311:00:013
2841052112,5sleep30-21swapper/310:40:023
2792202112,5sleep30-21swapper/310:35:573
2590802112,5sleep30-21swapper/310:15:013
2495372112,5sleep30-21swapper/310:06:033
2349412112,5sleep30-21swapper/309:51:073
2299152112,5sleep30-21swapper/309:46:053
2254002112,5sleep30-21swapper/309:41:083
2050562112,5sleep30-21swapper/309:21:053
1977442112,6sleep30-21swapper/309:11:093
1886912111,5sleep30-21swapper/309:01:153
1751172112,5sleep30-21swapper/308:51:033
1556112111,6sleep30-21swapper/308:31:053
1501272112,5sleep30-21swapper/308:25:593
1347332112,5sleep30-21swapper/308:10:023
1296992112,5sleep30-21swapper/308:06:003
1251052112,5sleep30-21swapper/308:01:043
1148742112,5sleep30-21swapper/307:51:043
1092962112,5sleep30-21swapper/307:45:023
1088802112,6sleep30-21swapper/307:42:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional