{"id":1708,"date":"2019-03-21T18:09:15","date_gmt":"2019-03-21T09:09:15","guid":{"rendered":"http:\/\/rageworx.info\/?p=1708"},"modified":"2022-06-16T00:26:51","modified_gmt":"2022-06-15T15:26:51","slug":"v4l2-v4l-utils-capture-for-multi-planar-2","status":"publish","type":"post","link":"https:\/\/rageworx.info\/?p=1708","title":{"rendered":"V4L2 + V4l-utils, Capture for multi-planar #2"},"content":{"rendered":"

This post was continued from “V4L2 + V4l-utils, Capture for multi-planar #1<\/a>“<\/p><\/blockquote>\n

Querying external controls<\/h2>\n

Getting external control should be an optional job, but it maybe needed to control brightness and gain for good to get excellent balanced image. Little bit difficult to understand in first time but can be understood soon.<\/p>\n

Query all user controls should be used as like this,<\/p>\n

struct v4l2_query_ext_ctrl* pExtCtl = new struct v4l2_query_ext_ctrl;\r\nmemset( pExtCtl, 0, sizeof( struct v4l2_query_ext_ctrl ) );\r\npExtCtl->id = V4L2_CID_USER_BASE;\r\n\r\nret = v4l_query_ext_ctrl( &camera_fd, pExtCtl, false, false );\r\nwhile( ret >= 0 )\r\n{\r\n    printf( \":::found external control : %X - %s\\n\",\r\n            pExtCtl->id,\r\n            pExtCtl->name );\r\n\r\n    unsigned tmpid = pExtCtl->id;\r\n    memset( pExtCtl, 0, sizeof( struct v4l2_query_ext_ctrl ) )\r\n    pExtCtl->id = tmpid;\r\n\r\n    \/\/ search for next control.\r\n    ret = v4l_query_ext_ctrl( &camera_fd, pExtCtl, true, false );\r\n\r\n    if ( pExtCtl->id == tmpid )\r\n        break;\r\n}\r\n\r\ndelete pExtCtl;\r\n<\/pre>\n
It shows all user controls as below result.<\/p>\n
:::found external control : 980900 -\r\n:::found external control : 980911 - Exposure\r\n:::found external control : 980913 - Gain\r\n:::found external control : 980914 - Horizontal Flip\r\n:::found external control : 980915 - Vertical Flip\r\n:::found external control : 9F0001 - Image Processing Controls\r\n:::found external control : 9F0901 - Link Frequency\r\n:::found external control : 9F0902 - Pixel Rate\r\n:::found external control : 9F0903 - Test Pattern\r\n:::found external control : 809F0903 -<\/pre>\n
Some user controls no name or symbol, so it should filtered out for only named control by checking string length with strlen().<\/p>\n
Some tweaks for exposure and gain<\/h3>\n
In search of looping by v4l_query_ext_ctrl(), it should be export some external control for future, and here some code for getting exposure and gain control.<\/p>\n
struct v4l2_query_ext_ctrl* pExtCtlExposure = NULL;\r\nstruct v4l2_query_ext_ctrl* pExtCtlGain = NULL;\r\n\r\nstruct v4l2_query_ext_ctrl* pExtCtl = new struct v4l2_query_ext_ctrl;\r\nmemset( pExtCtl, 0, sizeof( struct v4l2_query_ext_ctrl ) );\r\npExtCtl->id = V4L2_CID_USER_BASE;\r\n\r\nret = v4l_query_ext_ctrl( &camera_fd, pExtCtl, false, false );\r\nwhile( ret >= 0 )\r\n{\r\n    unsigned tmpid = pExtCtl->id;\r\n    \r\n    switch( pExtCtl->id )\r\n    {\r\n        case V4L2_CID_EXPOSURE:\r\n            pExtCtlExposure = pExtCtl;\r\n            break;\r\n            \r\n        case V4L2_CID_GAIN:\r\n            pExtCtlGain = pExtCtl;\r\n            break;\r\n            \r\n        default:\r\n            delete pExtCtl;\r\n    }\r\n        \r\n    pExtCtl = new struct v4l2_query_ext_ctrl;\r\n    memset( pExtCtl, 0, sizeof( struct v4l2_query_ext_ctrl ) );    \r\n    pExtCtl->id = tmpid;\r\n\r\n    \/\/ search for next control.\r\n    ret = v4l_query_ext_ctrl( &camera_fd, pExtCtl, true, false );\r\n\r\n    if ( pExtCtl->id == tmpid )\r\n        break;\r\n}\r\n<\/pre>\n
Then, exposure should be adjusted as below:<\/p>\n
bool adjustExposure( int val )\r\n{\r\n    struct v4l2_control c = {0};\r\n\r\n    int  maxv = pExtCtlExposure->maximum;\r\n    int  minv = pExtCtlExposure->minimum;\r\n    int  step = pExtCtlExposure->step;\r\n\r\n    if ( val > maxv )\r\n        val = maxv;\r\n    else\r\n    if ( val < minv )\r\n        val = minv;\r\n    \r\n    c.id    = V4L2_CID_EXPOSURE;\r\n    c.value = step * ( val \/ step );\r\n    int ret = v4l_ioctl( cfd, VIDIOC_S_CTRL, &c );\r\n\r\n    if ( ret < 0 )\r\n    {\r\n        perror( \"EXPOSURE CONTROL\" );\r\n        return false;\r\n    }\r\n\r\n    return true;\r\n}<\/pre>\n
Now, it’s turn to capture<\/h2>\n
To getting secured image from MIPI CSI-2 camera types with Multiplanar, it should be recommended using memory type for NMAP for quickly approaching to driver side memroy access. And need to following sequence to prepare buffers to be get image data from memory in directly.<\/p>\n
unsigned memtype = V4L2_MEMORY_MMAP;\r\n\r\nv4l_buffer vbuffer;\r\nv4l_buffer_init( &vbuffer, captype, memtype, 0 );\r\nv4l_queue  vqueue;\r\n\r\nret = v4l_buffer_prepare_buf( &cam1, &vbuffer );\r\nif ( ret < 0 ) perror( \"v4l_buffer_prepare_buf()\" );\r\n\r\nv4l_queue_init( &vqueue, captype, memtype );\r\n\r\nret = v4l_queue_querybufs( &cam1, &vqueue, 0 );\r\nif ( ret < 0 ) perror( \"v4l_queue_querybufs()\" );\r\n\r\nret = v4l_queue_reqbufs( &cam1, &vqueue, REQ_BUFF_SZ );\r\nif ( ret < 0 ) perror( \"v4l_queue_reqbufs()\" );\r\n\r\nret = v4l_queue_mmap_bufs( &cam1, &vqueue, 0 );\r\nif ( ret < 0 ) perror( \"v4l_queue_mmap_bufs()\" );<\/pre>\n
REQ_BUFF_SZ is a pre-definition set for 4. And v4l_queu_reqbufs() count at least or bigger than 4. Now you can make stream on for grab continuously buffers.<\/p>\n
Make it streamed on<\/h2>\n
Before it captures any image from camera, it must be started streaming to \u201con\u201d as below:<\/p>\n
int ret = v4l_ioctl( &cam1, VIDIOC_STREAMON, &vqueue.type );\r\nif ( ret < 0 ) perror( \"v4l_ioctrl(VIDIOC_STREAMON)\" );<\/pre>\n
If it fails or, doesn’t do this, it will impossibly get real captured image \u2013 just blacked (NULL) image may receive.<\/p>\n
Wait for a sync.<\/h2>\n
Every camera, monitors has V-Sync signal for complete draw and capture. V4L just simply can make it sens with select() as below code:<\/p>\n
fd_set fds;\r\n\r\nFD_ZERO( &fds );\r\nFD_SET( realfd, &fds );\r\n\r\nstruct timeval tv;\r\ntv.tv_sec = 1;\r\ntv.tv_usec = 0;\r\n\r\nret = select( realfd + 1, &fds, NULL, NULL, &tv );\r\nif ( ret <= 0 ) perror( \"wait sync failure.\\n\" );<\/pre>\n
If it returns to failure, just skip for capturing image.<\/p>\n
Getting an image now<\/h2>\n
When it succeeds to wait a V-Sync, now time to get image as below:<\/p>\n
int ret = v4l_buffer_dqbuf( &camera_fd, &vbuffer );\r\nif ( ret < 0 ) perror( \"v4l_buffer_dqbuf()\" );\r\n\r\nunsigned bufflen = v4l_queue_g_length( &vqueue, 0 );\r\nif ( bufflen > 0 )\r\n{\r\n    size_t bidx = 0;\r\n    void* ptrData = v4l_queue_g_mmapping( &vqueue, bidx, 0 );\r\n    if ( ptrData != NULL )\r\n    {\r\n        \/\/ ptrData is RAW pixel array from camera or ISP.\r\n    }\r\n}\r\n\r\nret = v4l_buffer_qbuf( &camera_fd, &vbuffer );\r\nif ( ret < 0 ) perror( \"v4l_buffer_qbuf()\" );<\/pre>\n
It’s done to get an image from camera with v4l_queue_g_mmapping().<\/p>\n
Conclusion<\/h2>\n
Controlling V4L2 with only native API is very hard to understand, controlling and handling all. But v4l-utils helps to make it easier than before but still hard to understand all because there are not many good examples not existed. So I will continue to writing some articles for understanding multiplanar typed camera accessing methods.<\/p>\n
Any question should be let written on guest book.<\/p>\n","protected":false},"excerpt":{"rendered":"
This post was continued from “V4L2 + V4l-utils, Capture for multi-planar #1“ Querying external controls Getting external control should be an optional job, but it maybe needed to control brightness and gain for good to get excellent balanced image. Little bit difficult to understand in first time but can be… Read more »<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5,573,3],"tags":[10,193,11,616,609,152,102,153,608,615,614,606],"class_list":["post-1708","post","type-post","status-publish","format-standard","hentry","category-development","category-embedded","category-raphs","tag-c","tag-camera","tag-code","tag-cpp","tag-csi2","tag-embedded","tag-example","tag-linux","tag-mipi","tag-v4l","tag-v4l-utils","tag-v4l2"],"_links":{"self":[{"href":"https:\/\/rageworx.info\/index.php?rest_route=\/wp\/v2\/posts\/1708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rageworx.info\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rageworx.info\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rageworx.info\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rageworx.info\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1708"}],"version-history":[{"count":0,"href":"https:\/\/rageworx.info\/index.php?rest_route=\/wp\/v2\/posts\/1708\/revisions"}],"wp:attachment":[{"href":"https:\/\/rageworx.info\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rageworx.info\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1708"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rageworx.info\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}