You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 23:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Apr 23, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32454211996,18sleep00-21swapper/007:08:070
32347211594,15sleep10-21swapper/107:06:441
316232114102,6sleep20-21swapper/207:05:162
31719210896,6sleep30-21swapper/307:05:173
289652690,0sleep10-21swapper/111:02:251
169202680,5sleep13262799cyclictest09:43:051
234012240,0sleep30-21swapper/309:50:123
96572230,1sleep09-21ksoftirqd/010:42:160
3262799221,19cyclictest0-21swapper/111:20:111
3262999210,19cyclictest60-21kswapd011:20:113
3262799211,18cyclictest0-21swapper/111:25:111
179672200,1sleep20-21swapper/211:25:112
32628991916,2cyclictest13827-21kworker/u8:010:55:042
32627991815,2cyclictest6934-21kworker/u8:110:49:041
32627991815,2cyclictest25218-21kworker/u8:112:11:041
3262799181,3cyclictest31232-21grep11:05:131
3262799180,13cyclictest0-21swapper/112:27:041
32626991815,2cyclictest3795-21kworker/u8:310:14:040
32628991714,2cyclictest29057-21kworker/u8:011:17:042
32628991714,2cyclictest12145-21kworker/u8:211:20:012
32628991714,2cyclictest10962-21kworker/u8:208:56:042
32627991714,2cyclictest23455-21kworker/u8:109:57:041
32627991714,2cyclictest1794-21kworker/u8:310:36:051
32627991712,3cyclictest207150irq/24-eth110:30:101
3262799171,14cyclictest3728-21runrttasks08:16:051
32626991714,2cyclictest27564-21kworker/u8:211:41:040
24532170,0sleep20-21swapper/211:09:122
3262999161,13cyclictest3728-21runrttasks09:49:143
3262999161,13cyclictest0-21swapper/310:01:263
32628991613,2cyclictest25127-21kworker/u8:008:28:042
32628991613,2cyclictest25127-21kworker/u8:008:16:042
32628991613,2cyclictest23455-21kworker/u8:110:00:052
32628991613,2cyclictest23410-21kworker/u8:111:00:012
3262899161,13cyclictest0-21swapper/207:25:002
3262899160,14cyclictest0-21swapper/211:41:042
3262899160,14cyclictest0-21swapper/210:14:042
32627991613,2cyclictest13827-21kworker/u8:010:29:041
32627991613,2cyclictest12150-21kworker/u8:209:49:041
3262799161,2cyclictest16662-21diskmemload12:19:041
3262799161,13cyclictest0-21swapper/107:10:151
32626991613,2cyclictest5014-21kworker/u8:011:46:050
32626991613,2cyclictest27564-21kworker/u8:211:38:050
32626991613,2cyclictest27564-21kworker/u8:211:38:050
32626991613,2cyclictest25218-21kworker/u8:112:13:040
32626991613,2cyclictest19882-21kworker/u8:110:23:040
3262999151,2cyclictest3823-21ssh10:36:023
32629991512,2cyclictest0-21swapper/309:13:023
32628991512,2cyclictest8818-21kworker/u8:008:54:042
32628991512,2cyclictest5557-21kworker/u8:009:36:042
32628991512,2cyclictest20128-21kworker/u8:207:59:042
32628991512,2cyclictest13827-21kworker/u8:010:52:052
32628991512,2cyclictest13827-21kworker/u8:010:27:042
32628991512,2cyclictest10787-21kworker/u8:207:38:042
3262899150,13cyclictest24898-21mailstats09:51:012
3262899150,13cyclictest0-21swapper/212:13:042
3262899150,13cyclictest0-21swapper/209:21:482
32627991512,2cyclictest8818-21kworker/u8:008:52:041
32627991512,2cyclictest5014-21kworker/u8:012:05:041
32627991512,2cyclictest27564-21kworker/u8:211:45:041
32627991512,2cyclictest25127-21kworker/u8:008:42:041
32627991512,2cyclictest14631-21kworker/u8:107:51:041
3262799150,2cyclictest2494-21ssh11:42:041
3262799150,13cyclictest0-21swapper/112:00:031
3262799150,13cyclictest0-21swapper/111:52:041
3262699151,2cyclictest4810-21apt-get08:40:110
32626991512,2cyclictest8713-21kworker/u8:110:08:040
32626991512,2cyclictest23410-21kworker/u8:110:57:040
3262699151,12cyclictest2656-21cpuspeed_turbos07:15:130
3262699151,12cyclictest21322-21iostat_ios12:35:160
3262699150,2cyclictest0-21swapper/011:25:110
3262699150,13cyclictest0-21swapper/009:40:120
3262699150,13cyclictest0-21swapper/009:30:120
182272150,0sleep20-21swapper/209:10:352
32629991411,2cyclictest12150-21kworker/u8:209:43:213
32629991411,2cyclictest0-21swapper/311:55:393
32629991410,2cyclictest11665-21ssh11:51:083
3262999140,2cyclictest0-21swapper/312:11:493
3262999140,12cyclictest32583-21sh11:06:033
3262999140,12cyclictest12900-21mandb07:40:123
3262999140,12cyclictest0-21swapper/312:05:023
3262999140,12cyclictest0-21swapper/310:44:243
32628991411,2cyclictest6523-21kworker/u8:208:45:042
32628991411,2cyclictest31078-21kworker/u8:208:32:042
32628991411,2cyclictest19348-21kworker/u8:212:26:042
32628991411,2cyclictest19348-21kworker/u8:212:01:042
32628991411,2cyclictest16662-21diskmemload12:35:182
32628991411,2cyclictest13827-21kworker/u8:010:36:012
32628991411,2cyclictest12150-21kworker/u8:209:47:042
32628991411,2cyclictest0-21swapper/211:36:182
32628991411,2cyclictest0-21swapper/211:36:182
32628991411,2cyclictest0-21swapper/209:05:182
3262899140,2cyclictest0-21swapper/211:46:052
3262899140,13cyclictest0-21swapper/210:20:482
3262899140,13cyclictest0-21swapper/210:08:042
3262899140,13cyclictest0-21swapper/207:40:182
3262899140,12cyclictest0-21swapper/209:30:132
3262799149,3cyclictest0-21swapper/111:14:241
3262799149,3cyclictest0-21swapper/110:01:331
3262799146,2cyclictest0-21swapper/111:19:031
32627991411,2cyclictest0-21swapper/109:20:031
3262799141,11cyclictest3649-21snmpd08:30:141
3262799140,3cyclictest6727-21aten2.4-expect07:25:121
3262799140,3cyclictest0-21swapper/112:30:111
3262799140,2cyclictest21-21rcuc/109:31:041
3262799140,2cyclictest0-21swapper/111:58:231
3262799140,2cyclictest0-21swapper/107:35:131
3262799140,12cyclictest0-21swapper/107:45:581
3262699149,3cyclictest30600-21sh11:04:590
32626991411,2cyclictest6978-21kworker/u8:111:14:040
32626991411,2cyclictest25127-21kworker/u8:008:14:040
32626991411,2cyclictest19348-21kworker/u8:212:20:040
32626991411,2cyclictest14931-21kworker/u8:109:29:040
3262699140,3cyclictest6729-21tail07:25:120
3262699140,2cyclictest0-21swapper/012:19:040
265242140,2sleep00-21swapper/012:06:470
32629991310,2cyclictest8826-21ssh11:49:123
32629991310,2cyclictest5710-21ssh11:11:303
32629991310,2cyclictest16662-21diskmemload11:41:293
32629991310,2cyclictest0-21swapper/312:36:433
32629991310,2cyclictest0-21swapper/312:21:223
32629991310,2cyclictest0-21swapper/312:04:113
32629991310,2cyclictest0-21swapper/311:15:453
32629991310,2cyclictest0-21swapper/309:30:373
3262999130,2cyclictest0-21swapper/312:17:133
3262999130,2cyclictest0-21swapper/311:36:243
3262999130,2cyclictest0-21swapper/311:36:243
3262999130,2cyclictest0-21swapper/310:56:533
3262999130,2cyclictest0-21swapper/310:46:033
3262999130,2cyclictest0-21swapper/310:30:343
3262999130,2cyclictest0-21swapper/309:55:163
3262999130,2cyclictest0-21swapper/308:35:163
3262999130,2cyclictest0-21swapper/308:35:163
3262999130,2cyclictest0-21swapper/307:30:153
3262999130,12cyclictest0-21swapper/311:32:313
3262999130,12cyclictest0-21swapper/311:03:113
3262999130,12cyclictest0-21swapper/310:29:033
3262999130,12cyclictest0-21swapper/309:35:433
3262999130,12cyclictest0-21swapper/309:25:493
3262999130,12cyclictest0-21swapper/309:16:273
3262999130,11cyclictest0-21swapper/309:21:333
32628991310,2cyclictest14631-21kworker/u8:107:52:042
32628991310,2cyclictest13827-21kworker/u8:010:41:042
32628991310,2cyclictest0-21swapper/211:52:002
32628991310,2cyclictest0-21swapper/209:55:132
32628991310,2cyclictest0-21swapper/209:17:382
32628991310,2cyclictest0-21swapper/209:00:132
32628991310,2cyclictest0-21swapper/208:40:292
3262899130,2cyclictest0-21swapper/212:21:042
3262899130,2cyclictest0-21swapper/212:15:162
3262899130,2cyclictest0-21swapper/212:06:342
3262899130,2cyclictest0-21swapper/211:31:082
3262899130,2cyclictest0-21swapper/208:10:142
3262899130,12cyclictest0-21swapper/211:12:582
3262899130,12cyclictest0-21swapper/210:34:582
3262899130,12cyclictest0-21swapper/210:16:282
3262899130,12cyclictest0-21swapper/209:26:382
3262899130,12cyclictest0-21swapper/207:45:122
3262899130,11cyclictest0-21swapper/212:31:512
3262799138,3cyclictest0-21swapper/108:10:131
3262799135,5cyclictest0-21swapper/108:24:591
3262799133,8cyclictest15147-21aten2.4_r3power10:15:121
3262799132,6cyclictest0-21swapper/108:30:001
32627991310,2cyclictest8713-21kworker/u8:110:13:041
32627991310,2cyclictest2280-21kworker/u8:108:49:041
32627991310,2cyclictest0-21swapper/110:55:061
32627991310,2cyclictest0-21swapper/110:53:531
32627991310,2cyclictest0-21swapper/110:09:451
32627991310,2cyclictest0-21swapper/109:10:561
3262799130,2cyclictest21-21rcuc/112:21:041
3262799130,2cyclictest207150irq/24-eth107:20:171
3262799130,2cyclictest0-21swapper/109:39:531
3262799130,12cyclictest0-21swapper/110:40:031
3262799130,12cyclictest0-21swapper/109:16:031
3262799130,11cyclictest0-21swapper/108:05:491
3262799130,11cyclictest0-21swapper/107:15:191
3262699131,2cyclictest369-21ssh10:33:050
32626991310,2cyclictest5014-21kworker/u8:011:56:040
32626991310,2cyclictest30473-21ssh09:56:390
32626991310,2cyclictest18231-21kworker/u8:209:19:040
32626991310,2cyclictest14631-21kworker/u8:107:50:040
32626991310,2cyclictest12150-21kworker/u8:209:50:040
32626991310,2cyclictest0-21swapper/010:00:160
32626991310,2cyclictest0-21swapper/009:37:090
32626991310,2cyclictest0-21swapper/009:10:160
32626991310,2cyclictest0-21swapper/008:55:170
32626991310,2cyclictest0-21swapper/008:45:300
32626991310,2cyclictest0-21swapper/008:25:390
32626991310,2cyclictest0-21swapper/008:05:160
3262699130,2cyclictest0-21swapper/012:26:030
3262699130,2cyclictest0-21swapper/011:15:130
3262699130,2cyclictest0-21swapper/009:00:150
3262699130,12cyclictest10981-21ssh11:50:390
3262699130,12cyclictest0-21swapper/012:32:500
3262699130,12cyclictest0-21swapper/011:20:290
11072130,2sleep00-21swapper/011:07:060
37332120,2sleep10-21swapper/108:35:501
37332120,2sleep10-21swapper/108:35:501
3262999129,2cyclictest0-21swapper/310:50:343
3262999129,2cyclictest0-21swapper/309:00:123
3262999122,7cyclictest0-21swapper/307:37:023
3262999120,2cyclictest0-21swapper/310:15:473
3262999120,11cyclictest0-21swapper/312:30:233
3262999120,11cyclictest0-21swapper/312:25:083
3262999120,11cyclictest0-21swapper/311:25:043
3262999120,11cyclictest0-21swapper/310:20:423
3262999120,11cyclictest0-21swapper/310:10:433
3262999120,11cyclictest0-21swapper/310:05:073
3262999120,11cyclictest0-21swapper/308:50:163
3262999120,11cyclictest0-21swapper/308:41:033
3262999120,11cyclictest0-21swapper/308:15:183
3262899129,2cyclictest6734-21kworker/u8:007:26:042
3262899128,3cyclictest11841-21munin-node2
3262899120,11cyclictest0-21swapper/211:56:462
3262899120,11cyclictest0-21swapper/208:00:162
3262799129,2cyclictest22310-21kworker/u8:111:30:041
3262799129,2cyclictest0-21swapper/112:37:551
3262799129,2cyclictest0-21swapper/109:26:461
3262799129,2cyclictest0-21swapper/108:00:181
3262799129,2cyclictest0-21swapper/107:55:141
3262799121,9cyclictest0-21swapper/109:05:131
3262799121,9cyclictest0-21swapper/109:00:491
3262799121,3cyclictest0-21swapper/107:31:041
3262799120,2cyclictest0-21swapper/111:35:331
3262799120,2cyclictest0-21swapper/111:35:331
3262799120,11cyclictest0-21swapper/110:20:431
3262799120,11cyclictest0-21swapper/109:51:441
3262699129,2cyclictest368-21kworker/u8:107:32:040
3262699129,2cyclictest16662-21diskmemload10:15:170
3262699129,2cyclictest0-21swapper/009:20:480
3262699129,2cyclictest0-21swapper/008:20:160
3262699129,2cyclictest0-21swapper/008:00:390
3262699129,2cyclictest0-21swapper/007:40:120
3262699129,2cyclictest0-21swapper/007:39:200
3262699120,2cyclictest0-21swapper/008:30:140
3262699120,2cyclictest0-21swapper/007:20:150
3262699120,11cyclictest0-21swapper/010:45:190
3262699120,11cyclictest0-21swapper/010:29:190
242552120,2sleep00-21swapper/011:30:590
217672120,2sleep00-21swapper/012:01:540
158962120,9sleep23649-21snmpd09:41:312
3262999118,2cyclictest0-21swapper/308:10:163
3262999118,2cyclictest0-21swapper/307:55:143
3262999118,2cyclictest0-21swapper/307:51:023
3262999111,7cyclictest4556-21metacity08:31:593
3262999111,7cyclictest12613-21chrt08:59:593
3262899118,2cyclictest26745-21kworker/u8:007:19:042
3262899118,2cyclictest0-21swapper/208:20:112
3262899110,2cyclictest0-21swapper/207:11:022
3262799113,7cyclictest0-21swapper/107:41:011
3262799111,8cyclictest11704-21ntpq08:55:161
3262699118,2cyclictest13827-21kworker/u8:010:51:040
3262699118,2cyclictest0-21swapper/009:45:380
3262699110,2cyclictest4539-21ssh10:36:500
3262699110,10cyclictest0-21swapper/008:16:020
3262999107,2cyclictest0-21swapper/308:25:013
3262999107,2cyclictest0-21swapper/307:20:123
3262999102,7cyclictest0-21swapper/308:22:593
3262999102,7cyclictest0-21swapper/307:47:593
3262999102,7cyclictest0-21swapper/307:18:583
3262999102,6cyclictest0-21swapper/307:13:593
3262699107,2cyclictest25127-21kworker/u8:008:36:040
3262699107,2cyclictest25127-21kworker/u8:008:36:040
3262699100,9cyclictest0-21swapper/007:10:090
3667290,2sleep20-21swapper/208:35:232
3667290,2sleep20-21swapper/208:35:232
326299992,6cyclictest0-21swapper/308:01:013
326299991,4cyclictest0-21swapper/308:10:003
326299991,4cyclictest0-21swapper/307:30:003
326289991,6cyclictest23835-21grep08:05:172
326289990,2cyclictest0-21swapper/207:32:042
326269994,3cyclictest8894-21aten2.4_r3power08:50:120
326269990,2cyclictest0-21swapper/007:50:000
326299984,2cyclictest15347-21fschecks_time09:05:133
326299983,3cyclictest6523-21kworker/u8:208:45:133
326269985,2cyclictest0-21swapper/009:05:140
326269984,3cyclictest2850-21rsyslogd07:56:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional