You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 08:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Nov 17, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16460211996,18sleep30-21swapper/319:09:273
16488211894,18sleep00-21swapper/019:09:480
16299211694,16sleep10-21swapper/119:07:201
16330211193,12sleep20-21swapper/219:07:452
132202790,0sleep20-21swapper/221:22:432
177242690,0sleep00-21swapper/022:00:400
16533993716,18cyclictest0-21swapper/023:35:120
283112220,0sleep30-21swapper/321:38:593
1653599210,16cyclictest0-21swapper/223:46:012
1653399211,2cyclictest0-21swapper/023:10:140
1653399210,19cyclictest0-21swapper/022:40:120
16535992017,2cyclictest7540-21kworker/u8:023:07:052
1653499200,18cyclictest0-21swapper/120:30:131
16536991916,2cyclictest26278-21kworker/u8:221:28:053
16536991916,2cyclictest26278-21kworker/u8:221:28:043
16535991916,2cyclictest7540-21kworker/u8:022:39:052
16535991916,2cyclictest17913-21kworker/u8:122:07:042
16535991916,2cyclictest17913-21kworker/u8:122:02:062
1653399190,2cyclictest0-21swapper/019:45:190
16536991815,2cyclictest31248-21kworker/u8:121:54:053
16535991815,2cyclictest7540-21kworker/u8:022:59:042
16535991815,2cyclictest26278-21kworker/u8:220:56:022
16535991815,2cyclictest13264-21kworker/u8:000:20:062
16535991813,3cyclictest9402-21ssh23:35:122
1653599180,3cyclictest0-21swapper/223:12:042
1653599180,2cyclictest0-21swapper/222:40:122
16536991714,2cyclictest23837-21kworker/u8:023:51:053
16536991712,3cyclictest0-21swapper/322:25:123
1653699170,2cyclictest0-21swapper/321:55:043
16535991714,2cyclictest7540-21kworker/u8:022:32:052
16535991714,2cyclictest6737-21kworker/u8:020:22:052
16535991714,2cyclictest4094-21kworker/u8:120:12:012
16535991714,2cyclictest20236-21kworker/u8:019:36:042
16535991714,2cyclictest17913-21kworker/u8:122:27:052
16535991714,2cyclictest16789-21kworker/u8:119:11:042
16535991714,2cyclictest16217-21kworker/u8:220:36:012
16535991714,2cyclictest11913-21kworker/u8:223:50:022
16535991714,2cyclictest10896-21kworker/u8:021:56:042
16535991714,2cyclictest10673-21kworker/u8:220:15:052
1653599170,3cyclictest0-21swapper/200:15:042
1653599170,12cyclictest0-21swapper/223:01:052
1653599170,12cyclictest0-21swapper/221:26:052
1653599170,12cyclictest0-21swapper/221:26:042
1653599170,12cyclictest0-21swapper/219:30:052
21622160,0sleep30-21swapper/322:53:233
16536991613,2cyclictest11913-21kworker/u8:223:38:053
16536991613,2cyclictest10896-21kworker/u8:022:16:023
1653699161,13cyclictest0-21swapper/320:30:263
16535991613,2cyclictest728-21kworker/u8:100:03:052
16535991613,2cyclictest728-21kworker/u8:100:03:042
16535991613,2cyclictest514-21kworker/u8:021:15:052
16535991613,2cyclictest326-21kworker/u8:222:22:042
16535991613,2cyclictest30403-21kworker/u8:220:01:042
16535991613,2cyclictest30403-21kworker/u8:219:45:042
16535991613,2cyclictest30403-21kworker/u8:219:43:052
16535991613,2cyclictest26278-21kworker/u8:221:39:052
16535991613,2cyclictest26278-21kworker/u8:221:10:012
16535991613,2cyclictest23837-21kworker/u8:023:57:052
16535991613,2cyclictest20236-21kworker/u8:019:54:052
16535991613,2cyclictest20236-21kworker/u8:019:26:052
16535991613,2cyclictest20236-21kworker/u8:019:18:052
16535991613,2cyclictest18692-21kworker/u8:223:26:022
1653599160,8cyclictest0-21swapper/223:24:012
1653599160,2cyclictest0-21swapper/223:32:022
1653599160,2cyclictest0-21swapper/221:49:042
1653599160,12cyclictest0-21swapper/220:41:052
1653599160,11cyclictest0-21swapper/222:48:042
1653499160,14cyclictest0-21swapper/123:22:531
16536991512,2cyclictest7540-21kworker/u8:022:36:053
16536991512,2cyclictest5853-21kworker/u8:200:08:063
16536991512,2cyclictest5853-21kworker/u8:200:08:053
16536991512,2cyclictest26278-21kworker/u8:221:30:043
16536991512,2cyclictest17913-21kworker/u8:122:03:053
16536991512,2cyclictest13264-21kworker/u8:000:19:053
16536991512,2cyclictest0-21swapper/322:20:113
1653699151,12cyclictest6133-21ssh22:56:513
1653699150,2cyclictest32683-21diskmemload22:08:043
1653699150,14cyclictest0-21swapper/300:35:303
16535991512,2cyclictest5853-21kworker/u8:200:10:042
16535991512,2cyclictest3790-21kworker/u8:100:37:042
16535991512,2cyclictest26555-21kworker/u8:122:54:052
16535991512,2cyclictest18794-21kworker/u8:021:02:042
16535991512,2cyclictest17913-21kworker/u8:122:18:052
16535991512,2cyclictest16217-21kworker/u8:220:27:042
1653599150,13cyclictest0-21swapper/221:51:352
1653399152,7cyclictest0-21swapper/020:55:000
1653399151,8cyclictest29158-21ssh00:30:000
1653399151,3cyclictest26371-21grep22:10:180
1653399151,3cyclictest11187-21iostat00:10:200
16533991510,3cyclictest3496-21ssh00:02:190
16533991510,3cyclictest3496-21ssh00:02:180
16536991411,2cyclictest31248-21kworker/u8:121:45:053
16536991411,2cyclictest20236-21kworker/u8:019:52:053
16536991411,2cyclictest18692-21kworker/u8:223:20:043
16536991411,2cyclictest11913-21kworker/u8:223:42:053
16536991411,2cyclictest0-21swapper/320:50:213
16536991410,2cyclictest23837-21kworker/u8:000:01:053
16536991410,2cyclictest23837-21kworker/u8:000:01:043
16536991410,2cyclictest0-21swapper/323:31:233
1653699140,3cyclictest18897-21missed_timers23:10:193
1653699140,2cyclictest0-21swapper/323:19:053
1653699140,2cyclictest0-21swapper/321:18:013
1653699140,13cyclictest32683-21diskmemload22:42:513
1653699140,13cyclictest32683-21diskmemload00:20:113
1653699140,12cyclictest0-21swapper/320:30:013
1653699140,12cyclictest0-21swapper/320:05:163
1653699140,12cyclictest0-21swapper/300:10:213
16535991411,2cyclictest4094-21kworker/u8:120:09:052
16535991411,2cyclictest30497-21kworker/u8:121:08:022
16535991411,2cyclictest13264-21kworker/u8:000:28:042
1653599140,2cyclictest0-21swapper/223:18:052
1653599140,2cyclictest0-21swapper/220:50:152
1653599140,2cyclictest0-21swapper/200:05:052
1653599140,2cyclictest0-21swapper/200:05:042
1653599140,12cyclictest0-21swapper/220:45:132
16534991411,2cyclictest32683-21diskmemload00:35:041
16534991411,2cyclictest0-21swapper/121:18:331
16534991410,2cyclictest0-21swapper/122:50:201
1653499140,2cyclictest32683-21diskmemload23:29:031
1653499140,2cyclictest0-21swapper/123:58:491
1653499140,2cyclictest0-21swapper/121:31:231
1653499140,2cyclictest0-21swapper/121:20:241
1653499140,2cyclictest0-21swapper/100:15:141
1653499140,2cyclictest0-21swapper/100:03:141
1653499140,2cyclictest0-21swapper/100:03:131
1653499140,13cyclictest32683-21diskmemload23:49:031
1653499140,13cyclictest0-21swapper/123:50:231
1653499140,13cyclictest0-21swapper/122:42:441
1653499140,12cyclictest0-21swapper/122:39:511
1653399142,6cyclictest0-21swapper/023:20:010
1653399140,12cyclictest17717-21ssh21:27:170
1653399140,12cyclictest17717-21ssh21:27:160
1653399140,12cyclictest0-21swapper/022:27:060
1653399140,12cyclictest0-21swapper/000:21:170
293922130,2sleep029402-21ssh00:30:040
211602130,2sleep10-21swapper/123:13:011
16536991310,2cyclictest31248-21kworker/u8:121:42:043
16536991310,2cyclictest30403-21kworker/u8:219:42:023
16536991310,2cyclictest26278-21kworker/u8:221:09:053
16536991310,2cyclictest24882-21kworker/u8:119:35:053
16536991310,2cyclictest15496-21ssh22:33:123
16536991310,2cyclictest13334-21kworker/u8:021:24:023
16536991310,2cyclictest0-21swapper/323:48:103
16536991310,2cyclictest0-21swapper/321:10:013
16536991310,2cyclictest0-21swapper/320:10:143
16536991310,2cyclictest0-21swapper/319:55:123
1653699130,2cyclictest32683-21diskmemload23:07:023
1653699130,2cyclictest0-21swapper/322:45:503
1653699130,2cyclictest0-21swapper/322:10:223
1653699130,2cyclictest0-21swapper/320:55:143
1653699130,12cyclictest0-21swapper/323:56:313
1653699130,12cyclictest0-21swapper/300:30:003
16535991310,2cyclictest5129-21runrttasks00:34:062
16535991310,2cyclictest31284-21ssh21:41:052
16535991310,2cyclictest0-21swapper/223:44:542
16535991310,2cyclictest0-21swapper/222:12:552
1653599130,2cyclictest0-21swapper/221:33:352
1653599130,2cyclictest0-21swapper/219:22:012
16534991310,2cyclictest0-21swapper/123:30:281
16534991310,2cyclictest0-21swapper/122:57:331
16534991310,2cyclictest0-21swapper/121:50:171
16534991310,2cyclictest0-21swapper/121:40:191
16534991310,2cyclictest0-21swapper/121:11:231
16534991310,2cyclictest0-21swapper/119:55:211
16534991310,2cyclictest0-21swapper/100:08:331
16534991310,2cyclictest0-21swapper/100:08:331
1653499130,2cyclictest0-21swapper/122:17:101
1653499130,2cyclictest0-21swapper/122:14:471
1653499130,12cyclictest0-21swapper/123:04:541
1653499130,12cyclictest0-21swapper/121:55:071
1653499130,12cyclictest0-21swapper/121:35:031
1653499130,11cyclictest32683-21diskmemload00:25:081
1653499130,11cyclictest0-21swapper/122:00:261
1653499130,11cyclictest0-21swapper/121:05:211
1653499130,11cyclictest0-21swapper/100:21:551
1653499130,10cyclictest0-21swapper/123:09:111
16533991310,2cyclictest0-21swapper/023:50:080
16533991310,2cyclictest0-21swapper/021:57:070
16533991310,2cyclictest0-21swapper/020:20:170
16533991310,2cyclictest0-21swapper/000:16:440
1653399130,2cyclictest32683-21diskmemload22:56:570
1653399130,2cyclictest0-21swapper/022:30:370
1653399130,2cyclictest0-21swapper/021:15:150
1653399130,2cyclictest0-21swapper/000:38:360
1653399130,12cyclictest0-21swapper/021:51:270
1653399130,11cyclictest32683-21diskmemload21:45:460
1653399130,11cyclictest23742-21ps19:25:180
1653399130,11cyclictest0-21swapper/000:06:520
1653399130,11cyclictest0-21swapper/000:06:510
1653699129,2cyclictest4654-21avahi-daemon23:26:133
1653699129,2cyclictest22893-21kworker/u8:120:46:043
1653699129,2cyclictest16789-21kworker/u8:119:13:043
1653699129,2cyclictest0-21swapper/323:00:433
1653699120,7cyclictest0-21swapper/320:21:043
1653699120,2cyclictest0-21swapper/300:33:033
1653599120,2cyclictest0-21swapper/220:34:052
1653499129,2cyclictest32683-21diskmemload23:40:231
1653499129,2cyclictest0-21swapper/122:32:231
1653499129,2cyclictest0-21swapper/122:20:091
1653499129,2cyclictest0-21swapper/120:55:201
1653499129,2cyclictest0-21swapper/120:40:301
1653499129,2cyclictest0-21swapper/100:30:141
1653499129,2cyclictest0-21swapper/100:10:031
1653499128,3cyclictest22604-21ssh22:05:531
1653499128,2cyclictest0-21swapper/120:00:201
1653499120,2cyclictest0-21swapper/119:35:201
1653499120,2cyclictest0-21swapper/119:25:151
1653499120,11cyclictest0-21swapper/123:36:461
1653499120,11cyclictest0-21swapper/123:16:381
1653499120,11cyclictest0-21swapper/122:45:441
1653499120,11cyclictest0-21swapper/122:26:291
1653499120,11cyclictest0-21swapper/121:45:101
1653499120,11cyclictest0-21swapper/120:25:141
1653399129,2cyclictest32683-21diskmemload23:25:030
1653399129,2cyclictest32683-21diskmemload22:53:070
1653399129,2cyclictest0-21swapper/023:40:570
1653399129,2cyclictest0-21swapper/023:16:230
1653399122,7cyclictest0-21swapper/022:16:590
1653399122,5cyclictest0-21swapper/021:15:010
1653399120,2cyclictest0-21swapper/023:06:000
1653399120,2cyclictest0-21swapper/022:36:560
1653399120,2cyclictest0-21swapper/021:22:170
1653399120,2cyclictest0-21swapper/019:15:270
1653399120,11cyclictest0-21swapper/023:55:140
1653399120,11cyclictest0-21swapper/023:30:490
1653399120,11cyclictest0-21swapper/023:03:360
1653399120,11cyclictest0-21swapper/022:05:370
1653399120,11cyclictest0-21swapper/021:40:070
1653399120,11cyclictest0-21swapper/020:05:160
243362110,2sleep30-21swapper/319:26:493
1653699118,2cyclictest0-21swapper/320:40:213
1653599118,2cyclictest2287-21copy19:55:042
1653499118,2cyclictest0-21swapper/121:25:231
1653499118,2cyclictest0-21swapper/121:25:221
1653499118,2cyclictest0-21swapper/119:40:231
1653499110,9cyclictest0-21swapper/120:05:281
1653499110,9cyclictest0-21swapper/119:20:111
1653499110,9cyclictest0-21swapper/119:10:181
1653499110,10cyclictest0-21swapper/119:52:481
1653399118,2cyclictest0-21swapper/021:32:170
1653399116,3cyclictest27667-21cut20:55:170
1653399113,6cyclictest278-21jbd2/sda1-822:20:210
1653399112,7cyclictest0-21swapper/023:45:010
1653399112,6cyclictest0-21swapper/019:12:010
1653699107,2cyclictest16217-21kworker/u8:220:37:043
1653699105,3cyclictest31083-21grep19:45:143
1653699105,3cyclictest21346-21tune2fs19:20:133
1653699105,3cyclictest10888-21cpu20:15:143
1653699102,6cyclictest0-21swapper/321:01:583
1653699101,7cyclictest0-21swapper/320:00:273
1653499107,2cyclictest0-21swapper/120:10:141
1653499107,2cyclictest0-21swapper/119:45:211
1653499106,2cyclictest0-21swapper/120:15:181
1653499100,8cyclictest0-21swapper/121:00:191
1653499100,8cyclictest0-21swapper/120:45:191
1653499100,8cyclictest0-21swapper/120:20:151
1653499100,8cyclictest0-21swapper/119:30:151
1653399107,2cyclictest0-21swapper/022:49:360
1653399107,2cyclictest0-21swapper/019:20:230
1653399105,3cyclictest266792sleep021:36:240
1653399105,3cyclictest15207-21grep20:25:160
1653399105,3cyclictest11559-21ntpq20:15:180
1653399105,3cyclictest0-21swapper/020:44:590
1653399102,7cyclictest0-21swapper/019:54:580
1653399102,6cyclictest0-21swapper/020:04:400
1653399101,6cyclictest0-21swapper/021:01:010
1653399101,6cyclictest0-21swapper/020:46:000
1653399100,8cyclictest0-21swapper/020:10:230
1653399100,6cyclictest0-21swapper/020:37:590
165369994,3cyclictest19254-21cut19:15:153
165369994,3cyclictest0-21swapper/319:30:173
165349990,8cyclictest0-21swapper/120:35:191
165349990,8cyclictest0-21swapper/119:15:131
165339994,3cyclictest3406-21ps19:55:200
165339994,3cyclictest30543-21chrt19:43:480
165339994,3cyclictest27597-21load19:35:180
165339994,3cyclictest24958-21aten2.4_r3power19:30:150
165339994,3cyclictest17363-21if_err_eth020:30:170
165339992,5cyclictest0-21swapper/021:05:010
165349980,2cyclictest0-21swapper/120:50:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional