You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 16:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue May 12, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2729621460,0sleep10-21swapper/109:11:031
8817211896,16sleep30-21swapper/307:08:493
8634211894,19sleep10-21swapper/107:06:271
7126211486,20sleep20-21swapper/207:05:122
8777210679,6sleep00-21swapper/007:08:180
76752850,1sleep07663-21munin-run12:20:000
76102760,1sleep10-21swapper/111:10:101
105122720,0sleep00-21swapper/008:30:590
16792280,0sleep11680-21ssh09:53:431
8940992117,3cyclictest6591-21kworker/u8:209:59:053
8939992017,2cyclictest29118-21kworker/u8:009:48:052
8940991916,2cyclictest2812-21kworker/u8:010:57:043
8939991916,2cyclictest9219-21kworker/u8:207:20:042
8939991916,2cyclictest3279-21kworker/u8:208:21:042
8939991916,2cyclictest31712-21kworker/u8:108:09:042
8939991916,2cyclictest2812-21kworker/u8:010:59:042
8939991916,2cyclictest2812-21kworker/u8:010:44:052
8939991916,2cyclictest25404-21kworker/u8:211:13:052
8939991916,2cyclictest13053-21kworker/u8:009:10:042
893999190,17cyclictest0-21swapper/211:22:042
8938991913,2cyclictest23825-21kworker/u8:210:29:051
8940991815,2cyclictest9219-21kworker/u8:207:19:043
8940991815,2cyclictest23825-21kworker/u8:210:19:043
8940991815,2cyclictest12006-21kworker/u8:009:32:063
8939991815,2cyclictest32317-21kworker/u8:309:24:022
8939991815,2cyclictest29980-21kworker/u8:110:39:072
8939991815,2cyclictest27609-21kworker/u8:209:25:042
8939991815,2cyclictest23505-21kworker/u8:207:54:022
8939991815,2cyclictest21016-21kworker/u8:211:45:052
8939991815,2cyclictest21016-21kworker/u8:211:45:042
8939991815,2cyclictest19144-21kworker/u8:010:12:062
8939991815,2cyclictest11693-21kworker/u8:110:07:042
8939991815,2cyclictest10149-21kworker/u8:212:34:052
8939991815,2cyclictest10149-21kworker/u8:212:23:052
893999180,17cyclictest0-21swapper/212:18:042
8940991714,2cyclictest6591-21kworker/u8:210:00:043
8940991714,2cyclictest16834-21kworker/u8:110:52:053
8940991714,2cyclictest15058-21kworker/u8:112:30:053
8940991714,2cyclictest15058-21kworker/u8:112:28:053
8940991714,2cyclictest11613-21kworker/u8:210:43:043
8939991714,2cyclictest28826-21kworker/u8:111:37:052
8939991714,2cyclictest21016-21kworker/u8:211:52:042
8939991714,2cyclictest19144-21kworker/u8:010:15:042
8939991714,2cyclictest18809-21kworker/u8:311:59:052
8939991714,2cyclictest15250-21kworker/u8:008:02:052
8939991714,2cyclictest15250-21kworker/u8:007:35:052
8939991714,2cyclictest13053-21kworker/u8:008:59:052
8939991714,2cyclictest13053-21kworker/u8:008:50:042
8939991714,2cyclictest13053-21kworker/u8:008:48:042
893999170,15cyclictest0-21swapper/209:40:042
8937991714,2cyclictest16042-21kworker/u8:111:22:040
8937991714,2cyclictest12006-21kworker/u8:009:37:050
8940991613,2cyclictest9165-21kworker/u8:011:32:053
8940991613,2cyclictest6591-21kworker/u8:210:05:053
8940991613,2cyclictest3386-21kworker/u8:112:17:043
8940991613,2cyclictest32317-21kworker/u8:309:26:043
8940991613,2cyclictest32317-21kworker/u8:309:20:053
8940991613,2cyclictest23553-21kworker/u8:109:14:013
8940991613,2cyclictest18809-21kworker/u8:312:14:053
8939991613,2cyclictest4060-21kworker/u8:111:06:042
8939991613,2cyclictest28826-21kworker/u8:112:01:042
8939991613,2cyclictest21016-21kworker/u8:211:28:052
8939991613,2cyclictest15250-21kworker/u8:008:11:042
893999160,2cyclictest0-21swapper/211:43:042
893999160,14cyclictest0-21swapper/207:58:042
8938991613,2cyclictest19144-21kworker/u8:010:12:021
8938991613,2cyclictest16834-21kworker/u8:110:48:041
8938991613,2cyclictest12006-21kworker/u8:009:38:051
8937991613,2cyclictest29980-21kworker/u8:110:37:050
8937991613,2cyclictest25404-21kworker/u8:211:14:040
8937991613,2cyclictest19826-21kworker/u8:312:36:050
893799161,13cyclictest23157-21apt-get07:45:050
8940991512,2cyclictest7450-21kworker/u8:108:32:043
8940991512,2cyclictest575-21kworker/u8:107:26:053
8940991512,2cyclictest3386-21kworker/u8:112:21:053
8940991512,2cyclictest31712-21kworker/u8:108:06:043
8940991512,2cyclictest28826-21kworker/u8:111:41:043
8940991512,2cyclictest23825-21kworker/u8:210:30:043
8940991512,2cyclictest21016-21kworker/u8:211:47:053
8940991512,2cyclictest21016-21kworker/u8:211:47:043
8940991512,2cyclictest20886-21ssh11:59:053
8940991512,2cyclictest19826-21kworker/u8:312:35:043
8940991512,2cyclictest19144-21kworker/u8:010:22:053
8940991512,2cyclictest16042-21kworker/u8:111:24:053
8940991512,2cyclictest15250-21kworker/u8:007:44:043
894099151,12cyclictest17076-21df09:35:143
893999151,3cyclictest0-21swapper/207:10:172
8939991512,2cyclictest575-21kworker/u8:107:29:052
8939991512,2cyclictest25404-21kworker/u8:211:04:052
8939991512,2cyclictest23843-21kworker/u8:209:53:042
8939991512,2cyclictest15250-21kworker/u8:008:15:052
8939991512,2cyclictest13053-21kworker/u8:009:05:052
8938991512,2cyclictest15058-21kworker/u8:112:27:041
893899150,2cyclictest0-21swapper/110:57:551
8937991512,2cyclictest28826-21kworker/u8:111:43:050
8937991512,2cyclictest21016-21kworker/u8:211:26:050
8937991512,2cyclictest12006-21kworker/u8:009:41:040
8937991512,2cyclictest0-21swapper/010:30:150
8940991411,2cyclictest6591-21kworker/u8:210:10:023
8940991411,2cyclictest575-21kworker/u8:107:30:043
8940991411,2cyclictest575-21kworker/u8:107:21:053
8940991411,2cyclictest3279-21kworker/u8:208:26:053
8940991411,2cyclictest29980-21kworker/u8:110:38:053
8940991411,2cyclictest2812-21kworker/u8:010:47:053
8940991411,2cyclictest23505-21kworker/u8:207:53:053
8940991411,2cyclictest21016-21kworker/u8:211:53:043
8940991411,2cyclictest16793-21kworker/u8:109:46:053
8940991411,2cyclictest15540-21kworker/u8:208:54:043
8940991411,2cyclictest13053-21kworker/u8:008:44:053
8940991411,2cyclictest13053-21kworker/u8:008:44:043
8940991410,2cyclictest22565-21missed_timers12:00:173
894099140,4cyclictest14188-21vmstat11:16:043
8939991411,2cyclictest23505-21kworker/u8:207:49:042
893999140,2cyclictest0-21swapper/210:24:052
893999140,2cyclictest0-21swapper/210:02:042
893999140,12cyclictest0-21swapper/212:36:042
893999140,12cyclictest0-21swapper/210:45:152
8938991411,2cyclictest13551-21ssh09:30:551
8938991411,2cyclictest0-21swapper/112:06:241
8938991411,2cyclictest0-21swapper/111:01:551
8938991410,2cyclictest25935-21munin-node1
8938991410,2cyclictest20390-21ssh12:33:041
893899140,2cyclictest0-21swapper/111:50:151
893899140,12cyclictest0-21swapper/111:57:131
893899140,12cyclictest0-21swapper/111:17:341
893899140,12cyclictest0-21swapper/108:55:501
8937991411,2cyclictest25404-21kworker/u8:211:16:050
8937991411,2cyclictest23825-21kworker/u8:210:28:020
8937991411,2cyclictest13053-21kworker/u8:009:00:040
8937991411,2cyclictest11693-21kworker/u8:110:16:040
893799140,2cyclictest0-21swapper/010:50:160
893799140,2cyclictest0-21swapper/007:40:160
893799140,12cyclictest0-21swapper/010:21:590
273662140,3sleep127370-21sh11:30:201
8940991310,2cyclictest9165-21kworker/u8:011:27:053
8940991310,2cyclictest9165-21kworker/u8:011:11:053
8940991310,2cyclictest575-21kworker/u8:107:11:053
8940991310,2cyclictest3279-21kworker/u8:208:18:053
8940991310,2cyclictest28826-21kworker/u8:112:07:053
8940991310,2cyclictest25404-21kworker/u8:211:05:043
8940991310,2cyclictest23505-21kworker/u8:207:47:053
8940991310,2cyclictest0-21swapper/311:36:513
8940991310,2cyclictest0-21swapper/309:16:513
894099130,2cyclictest0-21swapper/311:00:023
894099130,2cyclictest0-21swapper/308:46:013
894099130,12cyclictest0-21swapper/310:26:313
894099130,11cyclictest29118-21kworker/u8:009:51:043
8939991310,2cyclictest27609-21kworker/u8:209:16:042
8939991310,2cyclictest0-21swapper/212:11:302
893999130,3cyclictest15341-21rm11:17:572
893999130,2cyclictest0-21swapper/210:28:012
893999130,2cyclictest0-21swapper/209:55:052
893999130,11cyclictest24931-21ssh10:53:462
893899131,11cyclictest0-21swapper/110:16:431
8938991310,2cyclictest3279-21kworker/u8:208:29:041
8938991310,2cyclictest28826-21kworker/u8:111:42:051
8938991310,2cyclictest27609-21kworker/u8:209:15:041
8938991310,2cyclictest18809-21kworker/u8:312:10:051
8938991310,2cyclictest0-21swapper/112:36:261
8938991310,2cyclictest0-21swapper/112:20:041
8938991310,2cyclictest0-21swapper/112:15:351
8938991310,2cyclictest0-21swapper/112:03:051
8938991310,2cyclictest0-21swapper/111:20:591
8938991310,2cyclictest0-21swapper/110:52:041
8938991310,2cyclictest0-21swapper/110:43:041
8938991310,2cyclictest0-21swapper/110:35:341
8938991310,2cyclictest0-21swapper/110:05:561
8938991310,2cyclictest0-21swapper/110:00:441
8938991310,2cyclictest0-21swapper/109:55:541
893899130,2cyclictest0-21swapper/111:06:031
893899130,2cyclictest0-21swapper/110:31:041
893899130,2cyclictest0-21swapper/109:45:371
893899130,2cyclictest0-21swapper/109:40:151
893899130,2cyclictest0-21swapper/109:20:181
893899130,2cyclictest0-21swapper/108:50:191
893899130,2cyclictest0-21swapper/108:00:411
893899130,2cyclictest0-21swapper/107:25:421
893899130,12cyclictest11250-21copy08:35:031
893899130,12cyclictest11250-21copy08:35:021
893899130,12cyclictest0-21swapper/111:45:161
893899130,12cyclictest0-21swapper/111:45:151
893899130,12cyclictest0-21swapper/111:36:151
893899130,12cyclictest0-21swapper/111:26:241
893899130,12cyclictest0-21swapper/109:27:051
893899130,12cyclictest0-21swapper/109:00:051
893899130,12cyclictest0-21swapper/107:45:051
893899130,11cyclictest0-21swapper/107:54:291
8937991310,2cyclictest7450-21kworker/u8:108:35:050
8937991310,2cyclictest7450-21kworker/u8:108:35:040
8937991310,2cyclictest6591-21kworker/u8:210:10:060
8937991310,2cyclictest575-21kworker/u8:107:39:040
8937991310,2cyclictest29118-21kworker/u8:010:02:050
8937991310,2cyclictest29118-21kworker/u8:009:50:040
8937991310,2cyclictest18809-21kworker/u8:312:00:060
8937991310,2cyclictest1568-21kworker/u8:109:55:040
8937991310,2cyclictest15250-21kworker/u8:007:58:040
8937991310,2cyclictest10162-21ssh11:46:390
8937991310,2cyclictest10162-21ssh11:46:380
8937991310,2cyclictest0-21swapper/012:25:110
8937991310,2cyclictest0-21swapper/011:32:560
8937991310,2cyclictest0-21swapper/011:00:570
8937991310,2cyclictest0-21swapper/009:30:160
8937991310,2cyclictest0-21swapper/009:23:260
8937991310,2cyclictest0-21swapper/009:17:150
893799130,2cyclictest17480-21munin-node0
893799130,2cyclictest0-21swapper/011:06:060
893799130,2cyclictest0-21swapper/010:55:450
893799130,2cyclictest0-21swapper/009:49:060
893799130,12cyclictest0-21swapper/012:32:100
893799130,12cyclictest0-21swapper/012:11:070
893799130,12cyclictest0-21swapper/012:05:370
893799130,12cyclictest0-21swapper/010:45:200
893799130,12cyclictest0-21swapper/010:42:450
893799130,12cyclictest0-21swapper/009:10:290
893799130,12cyclictest0-21swapper/007:50:160
893799130,12cyclictest0-21swapper/007:21:030
893799130,12cyclictest0-21swapper/007:16:030
893799130,11cyclictest0-21swapper/011:55:130
894099129,2cyclictest23505-21kworker/u8:208:00:053
894099129,2cyclictest13053-21kworker/u8:009:02:043
894099128,2cyclictest27575-21munin-node3
894099120,2cyclictest0-21swapper/307:39:053
893999129,2cyclictest7106-21rm10:34:482
893999129,2cyclictest0-21swapper/211:30:582
893999129,2cyclictest0-21swapper/208:35:062
893999129,2cyclictest0-21swapper/208:35:052
893999120,2cyclictest0-21swapper/209:30:482
893999120,2cyclictest0-21swapper/208:27:052
893999120,11cyclictest28847-21ssh12:06:592
893999120,11cyclictest0-21swapper/212:26:392
893899129,2cyclictest13053-21kworker/u8:009:07:041
893899129,2cyclictest13053-21kworker/u8:008:47:051
893899129,2cyclictest0-21swapper/108:30:101
893899129,2cyclictest0-21swapper/107:15:151
893899120,11cyclictest0-21swapper/108:10:141
893899120,10cyclictest0-21swapper/107:35:411
893799129,2cyclictest3279-21kworker/u8:208:28:040
893799129,2cyclictest32317-21kworker/u8:309:28:050
893799129,2cyclictest15250-21kworker/u8:007:31:040
893799129,2cyclictest0-21swapper/010:05:190
893799120,2cyclictest0-21swapper/011:51:090
893799120,11cyclictest0-21swapper/012:22:460
893799120,11cyclictest0-21swapper/011:36:030
893799120,11cyclictest0-21swapper/008:41:370
893799120,11cyclictest0-21swapper/008:41:370
235552120,2sleep30-21swapper/309:41:353
894099110,10cyclictest0-21swapper/308:10:403
893999110,2cyclictest0-21swapper/208:41:052
893999110,2cyclictest0-21swapper/208:41:042
893999110,2cyclictest0-21swapper/207:15:042
893999110,10cyclictest0-21swapper/209:39:372
893999110,10cyclictest0-21swapper/209:03:042
893899118,2cyclictest3279-21kworker/u8:208:22:041
893899118,2cyclictest0-21swapper/107:31:051
893899118,2cyclictest0-21swapper/107:10:141
893799118,2cyclictest575-21kworker/u8:107:27:050
893799118,2cyclictest575-21kworker/u8:107:13:040
893799118,2cyclictest15250-21kworker/u8:008:20:040
893799118,2cyclictest13053-21kworker/u8:008:49:050
894099107,2cyclictest0-21swapper/309:00:013
894099107,2cyclictest0-21swapper/308:20:113
893899107,2cyclictest575-21kworker/u8:107:40:051
893899107,2cyclictest31614-21apt-get08:05:111
893899100,8cyclictest0-21swapper/107:55:151
893899100,2cyclictest0-21swapper/107:20:181
893799107,2cyclictest0-21swapper/008:55:150
89409994,3cyclictest24879-21cat09:06:043
89409994,3cyclictest11737-21tr08:35:133
89409994,3cyclictest11737-21tr08:35:123
89399994,3cyclictest9491-21telnet08:30:102
89399994,3cyclictest0-21swapper/207:40:142
89399990,2cyclictest0-21swapper/207:31:042
89389990,8cyclictest0-21swapper/108:15:131
89379996,2cyclictest0-21swapper/008:10:130
89379996,2cyclictest0-21swapper/008:05:500
89379994,3cyclictest3642-21fschecks_count08:15:150
89379994,3cyclictest29745-21hostname08:00:130
89389980,7cyclictest0-21swapper/108:40:111
89389980,7cyclictest0-21swapper/108:40:111
89379985,2cyclictest24115-21perl09:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional