You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 02:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Fri May 01, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
273242120109,6sleep10-21swapper/119:05:401
27757211795,16sleep00-21swapper/019:06:030
26667211097,6sleep20-21swapper/219:05:132
27760210493,6sleep30-21swapper/319:06:073
269102820,0sleep20-21swapper/222:00:392
73372790,0sleep2301ktimersoftd/223:25:132
85392760,0sleep30-21swapper/300:38:573
123662750,1sleep10-21swapper/123:30:161
123662750,1sleep10-21swapper/123:30:161
257622710,1sleep125765-21cpuspeed_turbos22:35:131
286882490,1sleep328687-21ssh23:13:193
2809699251,3cyclictest0-21swapper/321:35:143
2809499250,23cyclictest0-21swapper/123:45:121
221332240,0sleep30-21swapper/320:15:133
2809699231,20cyclictest25247-21ssh23:45:123
2809699221,3cyclictest0-21swapper/322:41:313
2809699220,3cyclictest22226-21ssh21:20:513
2809699220,3cyclictest0-21swapper/322:00:143
2809699220,12cyclictest10301-21ssh23:28:173
2809699211,2cyclictest0-21swapper/320:05:113
2809699210,3cyclictest30134-21cut20:35:103
2809699210,3cyclictest21172-21aten2.4-expect23:40:143
2809699210,3cyclictest0-21swapper/322:35:153
2809699210,3cyclictest0-21swapper/321:05:153
2809699210,3cyclictest0-21swapper/319:40:143
2809699210,2cyclictest0-21swapper/320:25:593
2809499210,19cyclictest0-21swapper/120:00:111
2809699200,3cyclictest31046-21ssh23:50:303
2809699200,3cyclictest28879-21hddtemp_smartct19:10:153
2809699200,3cyclictest2834-21ssh23:20:143
2809699200,3cyclictest27070-21python21:26:023
2809699200,3cyclictest24258-21ssh21:58:193
2809699200,3cyclictest21244-21pzem_power20:10:423
2809699200,3cyclictest17296-21ssh00:12:593
2809699200,3cyclictest17022-21fschecks_time23:00:153
2809699200,3cyclictest1489-21ssh21:34:273
2809699200,3cyclictest11595-21diskmemload00:08:303
2809699200,3cyclictest0-21swapper/323:30:153
2809699200,3cyclictest0-21swapper/323:30:143
2809699200,3cyclictest0-21swapper/320:50:143
2809699200,3cyclictest0-21swapper/300:28:223
2809699200,3cyclictest0-21swapper/300:21:513
2809699200,2cyclictest0-21swapper/323:56:493
2809599200,18cyclictest0-21swapper/221:10:112
2809499200,3cyclictest0-21swapper/122:12:051
2809699190,3cyclictest8953-21munin-node3
2809699190,3cyclictest7217-21sort00:00:143
2809699190,3cyclictest18147-21ssh21:16:063
2809699190,3cyclictest13719-21ssh21:46:193
2809699190,3cyclictest0-21swapper/323:16:223
2809699190,3cyclictest0-21swapper/322:28:463
2809699190,3cyclictest0-21swapper/300:30:143
2809699190,17cyclictest0-21swapper/322:32:483
2809699190,17cyclictest0-21swapper/322:05:593
28094991916,2cyclictest1291-21kworker/u8:023:42:041
2809399191,3cyclictest7294-21ssh22:15:120
208982190,1sleep20-21swapper/223:40:032
2809699180,3cyclictest14006-21ssh22:56:303
2809699180,2cyclictest20034-21ssh00:15:343
2809599182,2cyclictest0-21swapper/222:12:052
28095991815,2cyclictest32654-21kworker/u8:222:53:042
28095991815,2cyclictest11784-21kworker/u8:100:32:042
28094991815,2cyclictest11784-21kworker/u8:100:17:041
28094991815,2cyclictest0-21swapper/121:15:121
2809699174,3cyclictest12146-21cpuspeed_turbos21:10:113
2809699170,3cyclictest9951-21ssh22:17:143
2809699170,2cyclictest0-21swapper/322:10:153
28095991714,2cyclictest7014-21kworker/u8:123:35:042
28095991714,2cyclictest24204-21kworker/u8:123:46:052
28094991714,2cyclictest7050-21kworker/u8:021:49:051
2809499170,15cyclictest0-21swapper/100:30:121
2809399174,11cyclictest3728-21runrttasks23:57:290
28093991711,4cyclictest10116-21munin-node0
28093991711,4cyclictest10116-21munin-node0
2809699166,8cyclictest0-21swapper/321:50:483
2809699164,3cyclictest24254-21df_abs20:20:133
2809699164,3cyclictest2035-21turbostat22:49:563
2809699164,3cyclictest11595-21diskmemload22:52:213
2809699161,3cyclictest0-21swapper/320:01:013
2809699161,12cyclictest21525-21df23:05:153
28095991613,2cyclictest25570-21kworker/u8:122:49:052
28094991613,2cyclictest32654-21kworker/u8:222:42:041
28094991613,2cyclictest14123-21kworker/u8:222:34:041
2809499161,13cyclictest22315-21munin-node1
2809499161,13cyclictest0-21swapper/122:55:141
28094991611,3cyclictest0-21swapper/121:06:011
2809499160,14cyclictest0-21swapper/100:26:071
2809399162,8cyclictest20718-21ssh23:40:010
2809399162,8cyclictest0-21swapper/020:25:000
28093991612,2cyclictest149562sleep022:23:170
28093991612,2cyclictest0-21swapper/022:30:150
2809699154,3cyclictest7074-21timerwakeupswit20:56:053
2809699154,2cyclictest0-21swapper/323:38:523
2809699153,3cyclictest4253-21tr19:30:133
2809699153,3cyclictest31427-21tr19:16:003
2809699153,3cyclictest28124-21cpu20:30:143
2809699153,3cyclictest13852-21chrt19:54:183
2809699151,3cyclictest0-21swapper/321:40:133
2809699151,3cyclictest0-21swapper/320:45:133
2809699151,3cyclictest0-21swapper/319:55:133
2809699151,3cyclictest0-21swapper/319:45:153
2809699151,3cyclictest0-21swapper/319:45:143
2809699151,3cyclictest0-21swapper/319:35:113
2809699151,3cyclictest0-21swapper/319:30:003
2809699151,3cyclictest0-21swapper/319:21:033
2809699150,4cyclictest0-21swapper/322:20:113
28095991512,2cyclictest7050-21kworker/u8:021:48:052
28095991512,2cyclictest32654-21kworker/u8:222:43:042
28095991512,2cyclictest22037-21kworker/u8:120:33:052
28095991512,2cyclictest16185-21kworker/u8:000:13:052
28095991512,2cyclictest15468-21kworker/u8:123:08:042
28095991512,2cyclictest11595-21diskmemload22:25:532
28094991512,2cyclictest25012-21kworker/u8:223:12:041
2809499150,2cyclictest0-21swapper/122:50:171
2809499150,13cyclictest0-21swapper/121:42:151
2809499150,13cyclictest0-21swapper/100:14:421
2809399152,8cyclictest20651-21ssh21:55:000
2809399152,7cyclictest0-21swapper/022:10:000
2809399152,11cyclictest0-21swapper/023:47:130
2809399151,12cyclictest0-21swapper/020:51:010
28093991510,3cyclictest28304-21munin-node0
2809399150,13cyclictest21219-21df_abs21:20:130
2809399150,13cyclictest0-21swapper/022:36:350
2809399150,13cyclictest0-21swapper/021:17:420
2809699141,3cyclictest32020-21seq20:40:103
28095991411,2cyclictest3561-21kworker/u8:119:31:042
28095991411,2cyclictest23267-21kworker/u8:222:08:042
28095991411,2cyclictest17716-21kworker/u8:120:05:052
28095991411,2cyclictest0-21swapper/221:22:032
2809599140,12cyclictest13762-21ssh22:21:202
2809599140,12cyclictest0-21swapper/200:27:172
28094991411,2cyclictest13178-21kworker/u8:019:56:061
28094991410,2cyclictest0-21swapper/121:55:141
28094991410,2cyclictest0-21swapper/119:15:131
2809499140,9cyclictest0-21swapper/119:41:041
2809499140,3cyclictest6060-21cut00:35:291
2809499140,2cyclictest23273-21aten2.4_r3power00:20:111
2809499140,12cyclictest11595-21diskmemload23:01:271
2809499140,12cyclictest0-21swapper/122:49:341
2809399149,3cyclictest0-21swapper/021:45:000
2809399149,3cyclictest0-21swapper/021:37:290
2809399149,3cyclictest0-21swapper/000:22:520
2809399142,6cyclictest0-21swapper/019:45:000
2809399141,7cyclictest29982-21ssh23:15:120
28093991411,2cyclictest0-21swapper/000:12:570
28093991410,3cyclictest0-21swapper/023:21:030
2809399140,2cyclictest0-21swapper/023:02:230
2809399140,13cyclictest101ktimersoftd/023:30:120
2809399140,13cyclictest101ktimersoftd/023:30:120
2809399140,13cyclictest0-21swapper/021:30:120
317382130,2sleep10-21swapper/122:05:511
2809599138,3cyclictest7522-21ssh00:37:142
28095991310,2cyclictest7050-21kworker/u8:021:44:042
28095991310,2cyclictest5800-21kworker/u8:219:47:052
28095991310,2cyclictest5800-21kworker/u8:219:47:042
28095991310,2cyclictest30063-21kworker/u8:221:29:042
28095991310,2cyclictest30063-21kworker/u8:220:38:012
28095991310,2cyclictest27849-21kworker/u8:219:13:052
28095991310,2cyclictest19389-21kworker/u8:022:30:052
28095991310,2cyclictest18468-21kworker/u8:121:52:042
28095991310,2cyclictest16185-21kworker/u8:000:15:042
28095991310,2cyclictest1518-21kworker/u8:122:15:042
28095991310,2cyclictest14123-21kworker/u8:222:35:052
28095991310,2cyclictest10185-21kworker/u8:119:53:042
28095991310,2cyclictest0-21swapper/223:54:142
28095991310,2cyclictest0-21swapper/221:15:042
28095991310,2cyclictest0-21swapper/221:00:172
28095991310,2cyclictest0-21swapper/220:20:172
28095991310,2cyclictest0-21swapper/200:05:332
28095991310,2cyclictest0-21swapper/200:00:152
2809599130,2cyclictest3649-21snmpd21:36:422
2809599130,2cyclictest0-21swapper/223:31:342
2809599130,2cyclictest0-21swapper/223:31:332
2809599130,2cyclictest0-21swapper/220:25:162
2809599130,12cyclictest0-21swapper/223:23:122
2809599130,12cyclictest0-21swapper/222:57:532
2809599130,12cyclictest0-21swapper/221:56:022
2809599130,12cyclictest0-21swapper/221:32:222
2809599130,11cyclictest11595-21diskmemload23:11:442
28094991310,2cyclictest4860-21kworker/u8:200:00:061
28094991310,2cyclictest3561-21kworker/u8:119:36:051
28094991310,2cyclictest17716-21kworker/u8:120:09:051
28094991310,2cyclictest0-21swapper/120:45:001
2809499130,2cyclictest0-21swapper/123:16:071
2809499130,2cyclictest0-21swapper/122:25:541
2809499130,2cyclictest0-21swapper/122:00:191
2809499130,2cyclictest0-21swapper/120:45:291
2809499130,12cyclictest0-21swapper/123:36:171
2809499130,12cyclictest0-21swapper/121:30:171
2809499130,12cyclictest0-21swapper/121:11:001
2809499130,11cyclictest0-21swapper/121:20:201
2809499130,11cyclictest0-21swapper/119:10:301
2809399139,3cyclictest0-21swapper/000:34:200
2809399138,3cyclictest0-21swapper/021:29:080
2809399132,6cyclictest0-21swapper/022:00:010
2809399132,6cyclictest0-21swapper/019:35:000
2809399131,2cyclictest0-21swapper/019:50:140
28093991310,2cyclictest0-21swapper/023:52:520
28093991310,2cyclictest0-21swapper/022:50:300
28093991310,2cyclictest0-21swapper/021:55:140
28093991310,2cyclictest0-21swapper/021:41:120
28093991310,2cyclictest0-21swapper/000:25:170
2809399130,3cyclictest0-21swapper/021:12:320
2809399130,2cyclictest28951-21ps20:30:190
2809399130,2cyclictest0-21swapper/023:13:420
2809399130,12cyclictest0-21swapper/023:40:520
2809599129,2cyclictest7832-21kworker/u8:019:40:042
2809599129,2cyclictest27849-21kworker/u8:219:15:042
2809599129,2cyclictest17716-21kworker/u8:120:03:042
2809599129,2cyclictest15208-21kworker/u8:220:13:042
2809599129,2cyclictest0-21swapper/223:15:322
2809599129,2cyclictest0-21swapper/220:45:122
2809599129,2cyclictest0-21swapper/219:20:122
2809599128,2cyclictest0-21swapper/220:55:182
2809599120,2cyclictest0-21swapper/223:55:262
2809599120,2cyclictest0-21swapper/223:01:352
2809599120,2cyclictest0-21swapper/220:16:022
2809599120,2cyclictest0-21swapper/219:25:102
2809599120,2cyclictest0-21swapper/200:21:252
2809499129,2cyclictest28813-21kworker/u8:022:21:041
2809499129,2cyclictest27849-21kworker/u8:219:24:051
2809499129,2cyclictest1960-21aten2.4_r3power23:55:111
2809499129,2cyclictest15208-21kworker/u8:220:25:041
2809499129,2cyclictest15208-21kworker/u8:220:20:051
2809499129,2cyclictest15208-21kworker/u8:220:16:041
2809499129,2cyclictest0-21swapper/123:25:171
2809499129,2cyclictest0-21swapper/123:21:021
2809499129,2cyclictest0-21swapper/119:50:281
2809499129,2cyclictest0-21swapper/119:45:151
2809499129,2cyclictest0-21swapper/119:45:151
2809499120,7cyclictest0-21swapper/100:05:041
2809499120,2cyclictest0-21swapper/122:18:011
2809499120,2cyclictest0-21swapper/121:50:241
2809499120,2cyclictest0-21swapper/121:35:531
2809499120,2cyclictest0-21swapper/121:26:021
2809499120,2cyclictest0-21swapper/120:59:591
2809499120,2cyclictest0-21swapper/120:55:151
2809499120,2cyclictest0-21swapper/120:30:131
2809499120,11cyclictest0-21swapper/123:52:291
2809499120,11cyclictest0-21swapper/120:35:091
2809399129,2cyclictest101ktimersoftd/022:27:160
2809399129,2cyclictest0-21swapper/023:09:010
2809399129,2cyclictest0-21swapper/022:49:230
2809399129,2cyclictest0-21swapper/020:41:010
2809399129,2cyclictest0-21swapper/000:04:150
2809399128,3cyclictest0-21swapper/022:40:170
2809399127,3cyclictest15947-21sendmail-msp20:00:010
2809399123,3cyclictest10085-1kworker/0:2H20:05:000
2809399122,7cyclictest0-21swapper/020:39:590
2809399121,2cyclictest0-21swapper/000:15:470
2809399120,2cyclictest101ktimersoftd/022:10:140
2809399120,1cyclictest101ktimersoftd/020:05:120
2809399120,11cyclictest0-21swapper/000:35:170
2809599118,2cyclictest3561-21kworker/u8:119:35:052
2809599118,2cyclictest0-21swapper/220:51:032
2809599116,3cyclictest3649-21snmpd21:06:352
2809599112,6cyclictest0-21swapper/219:55:022
2809499111,3cyclictest20202-21munin-node1
2809499110,9cyclictest3634-21munin-node1
2809499110,9cyclictest0-21swapper/119:30:491
2809499110,9cyclictest0-21swapper/119:25:141
2809399118,2cyclictest0-21swapper/022:59:430
2809399118,2cyclictest0-21swapper/000:07:430
2809399112,7cyclictest0-21swapper/020:24:590
2809399112,7cyclictest0-21swapper/020:12:020
2809399112,6cyclictest0-21swapper/019:36:170
2809399112,6cyclictest0-21swapper/019:23:010
2809399111,9cyclictest101ktimersoftd/023:25:120
2809399111,6cyclictest0-21swapper/019:26:150
2809399106,2cyclictest7579-21sendmail-msp20:59:590
2809399104,4cyclictest22849-21proc_pri20:15:180
2809399100,7cyclictest0-21swapper/021:05:010
2809399100,6cyclictest0-21swapper/020:46:310
280959996,2cyclictest22037-21kworker/u8:120:42:042
280939994,3cyclictest30694-21sed19:15:120
280939993,4cyclictest7827-21stty21:00:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional